-- Logs begin at Sun 2022-10-16 00:10:25 UTC, end at Sun 2022-10-16 01:12:32 UTC. -- Oct 16 00:42:43.343024 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 16 00:42:43.351866 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 16 00:42:43.356125 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 16 00:42:43 2022] *** Oct 16 00:42:43.356273 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 16 00:42:43.356400 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 16 00:42:43.356513 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: nodename: dv-osbrick-master-4-iscsi Oct 16 00:42:43.356617 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: machine: x86_64 Oct 16 00:42:43.356721 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: clock source: unix Oct 16 00:42:43.356821 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: pcre jit disabled Oct 16 00:42:43.356927 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: detected number of CPU cores: 4 Oct 16 00:42:43.357029 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: current working directory: / Oct 16 00:42:43.357130 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: detected binary path: /usr/bin/uwsgi-core Oct 16 00:42:43.357238 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: your processes number limit is 47680 Oct 16 00:42:43.357341 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: your memory page size is 4096 bytes Oct 16 00:42:43.357434 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: detected max file descriptor number: 2048 Oct 16 00:42:43.357541 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: lock engine: pthread robust mutexes Oct 16 00:42:43.357801 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: thunder lock: enabled Oct 16 00:42:43.358083 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 16 00:42:43.358280 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 16 00:42:43.397118 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: Python main interpreter initialized at 0x564e6653e9c0 Oct 16 00:42:43.397118 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: python threads support enabled Oct 16 00:42:43.397118 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: your server socket listen backlog is limited to 100 connections Oct 16 00:42:43.397118 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: your mercy for graceful operations on workers is 90 seconds Oct 16 00:42:43.397533 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: mapped 403077 bytes (393 KB) for 2 cores Oct 16 00:42:43.397533 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: *** Operational MODE: preforking *** Oct 16 00:42:43.397815 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: *** uWSGI is running in multiple interpreter mode *** Oct 16 00:42:43.397815 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: spawned uWSGI master process (pid: 81405) Oct 16 00:42:43.398027 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 16 00:42:43.399456 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: spawned uWSGI worker 1 (pid: 81417, cores: 1) Oct 16 00:42:43.399456 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: spawned uWSGI worker 2 (pid: 81418, cores: 1) Oct 16 00:42:43.399456 dv-osbrick-master-4-iscsi devstack@keystone.service[81405]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 16 00:42:47.724189 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:47.724189 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: from cryptography.utils import int_from_bytes Oct 16 00:42:47.725028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:47.725028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: from cryptography.utils import int_from_bytes Oct 16 00:42:47.725472 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:47.725472 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: from cryptography.utils import int_from_bytes Oct 16 00:42:47.725585 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:47.725585 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: from cryptography.utils import int_from_bytes Oct 16 00:42:47.775039 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:42:47.775245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:42:47.775404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] command line args: [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:42:47.775670 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:42:47.775758 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:42:47.775835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ================================================================================ {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:42:47.775915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:42:47.776048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] command line args: [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:42:47.776134 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] admin_token = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.776330 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] config_dir = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.776421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:42:47.776503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ================================================================================ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:42:47.776581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.776694 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] config_source = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.776778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] admin_token = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.776881 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] debug = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777002 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] config_dir = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777090 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] config_source = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] debug = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777597 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777745 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777889 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778198 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] list_limit = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] log_config_append = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] log_dir = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.778941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] log_file = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] log_config_append = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779334 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779334 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] log_dir = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] log_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779809 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.779888 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780017 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780173 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780442 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780734 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.780921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.781082 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.781179 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.781330 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.781460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782187 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782419 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.782918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.783103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.783326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.783413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.783509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] publish_errors = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.783620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.783741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.783971 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784194 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] publish_errors = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784568 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784645 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784898 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] standard_threads = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.784979 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785057 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785303 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] use_journal = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] standard_threads = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] use_json = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.785915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786064 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] use_stderr = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] use_syslog = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786330 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] use_journal = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786610 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.786689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] use_json = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.786823 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.786905 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] use_stderr = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.787023 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] use_syslog = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.787099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.787257 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:47.787335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.787521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.787598 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.787762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.787838 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788008 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788086 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788242 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788336 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788513 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.788838 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789483 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789561 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.789960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790045 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790428 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790753 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.790926 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791244 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791401 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791483 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791710 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.791971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792225 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792719 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792863 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.792954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793093 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793171 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793325 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793401 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793656 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.793894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794594 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.794993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795080 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795229 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795312 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795454 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.795999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796147 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.796939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.797096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.797971 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798569 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798743 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798812 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.798957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799150 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.799887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800007 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800113 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800242 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800399 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800610 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800722 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.800954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801039 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801309 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801418 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801731 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.801962 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802133 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802219 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802442 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802595 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802675 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.802970 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803154 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803402 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803553 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803792 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.803868 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804531 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804609 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.804845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805246 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805323 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805556 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.805951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806509 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806737 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.806971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807206 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807594 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807670 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807835 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.807921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808154 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.808888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809123 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809352 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809730 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809817 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.809958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810493 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810644 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.810954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811341 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811425 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811572 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811813 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.811891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812142 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812302 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] auth.external = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812647 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.812923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] auth.password = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813731 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.external = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813807 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] auth.token = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.813887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814091 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814323 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814576 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.password = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814798 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.token = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.814962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815041 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815286 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815506 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815663 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] credential.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815908 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.815996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816156 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816656 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816745 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.816976 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817372 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817617 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817696 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.817926 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818180 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818341 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818675 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818839 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.818943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819082 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819333 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.819889 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820289 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820397 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.820865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821020 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821101 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821581 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.821983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822062 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822227 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822459 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.822946 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823186 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823479 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.823952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824107 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824185 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824372 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824853 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.824932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825081 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825159 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825310 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825390 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825629 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.825871 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826119 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826355 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826504 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826832 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.826993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827690 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827769 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.827997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828520 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828675 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828829 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.828969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829135 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829237 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829378 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829737 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829853 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.829992 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830096 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830840 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.830967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831209 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831290 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831912 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.831990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.832142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.832282 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.832440 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.832557 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.832637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.832804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.832884 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.833037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.833125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.833268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.833724 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.833810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.833989 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834242 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834712 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834791 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.834942 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835021 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835260 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835435 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835743 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835905 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.835983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836407 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836489 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836644 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836874 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.836953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837109 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837191 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837342 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837808 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.837889 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838132 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838291 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.838851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839007 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839479 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.839952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840033 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840689 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.840930 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841008 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841637 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841880 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.841958 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842115 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842662 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.842909 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843302 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843539 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843778 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.843857 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.844556 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.844647 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.844817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.844980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845229 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845808 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.845975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846053 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846530 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] role.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846912 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] role.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.846995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847391 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.847954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] role.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848464 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] role.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.848939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849700 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.849928 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850288 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850717 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850797 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.850953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851528 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851694 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851772 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.851947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852230 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852499 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852674 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.852992 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853374 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853602 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853682 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.853937 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854103 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854190 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854428 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854584 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854663 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.854908 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855122 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855355 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855599 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.855989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.856964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857054 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857203 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.857993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858474 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858640 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858717 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.858962 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.859113 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.859195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.859353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.859433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.859592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.859850 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.connection = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.859939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860129 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860396 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860481 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.860950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861104 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861417 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861571 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.861894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862052 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862133 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862372 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862523 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862760 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.862991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863235 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863316 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863543 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863700 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863780 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.863932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.864013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.864087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:42:47.864182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.864451 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.864701 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.864936 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.865181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:47.865592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:42:47.894725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.894949 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.895171 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.895302 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.895541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.895771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.903494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.904151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.932368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.932595 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.932680 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.932875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.986792 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:47.987582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.035402 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.035642 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.036536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.036777 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.195122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.195122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.195478 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.195587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.195718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.195823 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.195923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.196023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.196123 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.196233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.196368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.196368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.218334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.218560 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.218647 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.218779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.218864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.219376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.219518 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.219624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.219738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.219844 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.219945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.220047 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.220147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.220147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.231169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.231446 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.244749 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.244929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245151 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245438 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245861 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.245987 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.246069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.246202 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.246418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.246633 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:48.263771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.263966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:48.264105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.264329 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.264417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:48.264544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:48.264677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.264824 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.264923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:48.265092 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.265175 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.265358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.265440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.265614 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.265697 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.265913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.275381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.275493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.275666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.275768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.275937 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.276020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.276220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.276305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.283690 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.283793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.286592 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.286723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.286875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287158 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287301 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287442 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287729 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.287990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.288131 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.288257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.288433 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.288552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.288713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.288821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.288986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.289096 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.289263 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.289347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.289536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.311947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.312220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.314058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.314340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.314509 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.314810 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.318967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.319251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.319532 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.319615 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.319867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.320154 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.325836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.326125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.326648 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.326939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.332426 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.332724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.333014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.333302 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.333385 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.333849 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.333935 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.334129 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.334222 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.334405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.334488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.334675 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.334758 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.334968 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.335249 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.335535 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.350058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.350336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.351015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.351299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.354187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.355118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.357415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.357712 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.358363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.358665 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.362057 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.362986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.365249 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.366171 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.368465 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.368764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.369331 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.369437 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.369624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.369708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.369910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.370048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.370268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.370565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.370863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.386153 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.386438 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.386705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.386970 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.387226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.387516 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.387787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.388055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.394461 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.395714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.396004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.397308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.397540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.397816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.398840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.399123 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.400494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.400779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.401060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.401342 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.401735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.401894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.402187 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.402479 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.402766 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.403162 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.412862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.413150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.413430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.413711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.414089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.414375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.414504 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.414649 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.414782 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.415023 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.415308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.415693 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.415987 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.416276 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.429914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.431658 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.432801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.434607 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.435659 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.437168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.437532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.439143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.439430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.439590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.439839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.441056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.441345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.441754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.446149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.447588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.448085 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.449587 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.450472 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.450863 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.451152 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.451432 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.452510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.452912 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.453205 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.454049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.460075 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.460385 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.460669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.462259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.462558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.462849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.467463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.467748 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.468030 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.468306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.468599 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.468869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.469181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.469462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.469728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.469880 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:48.470019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.470156 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.470296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.470435 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.470614 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.470765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.470893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.471024 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.471154 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.471295 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.471457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.471722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.472001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.472276 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.472582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.472856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.473128 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.473409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:48.505240 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e6653e9c0 pid: 81417 (default app) Oct 16 00:42:48.507886 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e6653e9c0 pid: 81418 (default app) Oct 16 00:42:48.508535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126734-3e0d-4bdf-a7d7-9bfcac18debf None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:48.508825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126734-3e0d-4bdf-a7d7-9bfcac18debf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:48.509100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126734-3e0d-4bdf-a7d7-9bfcac18debf None None] PATH_INFO: `/v3` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:48.513223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Sun Oct 16 00:42:48 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:55.437240 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a5a21-e9ec-43d0-bc01-db971a6010f6 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.437795 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a5a21-e9ec-43d0-bc01-db971a6010f6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.437885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a5a21-e9ec-43d0-bc01-db971a6010f6 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.442083 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:42:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:55.447716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.448274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.448274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.519853 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: INFO dbcounter [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] Registered counter for database keystone Oct 16 00:42:55.539894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG oslo_db.sqlalchemy.engines [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:42:55.546204 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writer thread running {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:42:55.742343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG passlib.handlers.bcrypt [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81417) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 16 00:42:55.745587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG passlib.handlers.bcrypt [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81417) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 16 00:42:55.802053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:55.803692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:55.934220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 16 00:42:56.225016 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a5a21-e9ec-43d0-bc01-db971a6010f6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:56.295377 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: INFO dbcounter [None req-9f1a5a21-e9ec-43d0-bc01-db971a6010f6 None None] Registered counter for database keystone Oct 16 00:42:56.317102 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG oslo_db.sqlalchemy.engines [None req-9f1a5a21-e9ec-43d0-bc01-db971a6010f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:42:56.323477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writer thread running {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:42:56.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a5a21-e9ec-43d0-bc01-db971a6010f6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.448343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea40cc-a55c-4345-bf22-c65e8de357ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.449004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea40cc-a55c-4345-bf22-c65e8de357ac admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.449285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea40cc-a55c-4345-bf22-c65e8de357ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.449556 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea40cc-a55c-4345-bf22-c65e8de357ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.459149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea40cc-a55c-4345-bf22-c65e8de357ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.510502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3fea40cc-a55c-4345-bf22-c65e8de357ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 16 00:42:56.510775 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea40cc-a55c-4345-bf22-c65e8de357ac admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.520978 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Oct 16 00:42:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:42:56.526902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:56.544152 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d93694-d3db-4230-9da0-b27eef4b2624 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.549212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27be5a-7a4e-43cf-8f83-1c4102d0e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.550307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27be5a-7a4e-43cf-8f83-1c4102d0e179 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.550585 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27be5a-7a4e-43cf-8f83-1c4102d0e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.550852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27be5a-7a4e-43cf-8f83-1c4102d0e179 admin admin] PATH_INFO: `/v3/projects/3c4625f8f78c492a895e7a32f39f3d29` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.552466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27be5a-7a4e-43cf-8f83-1c4102d0e179 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4625f8f78c492a895e7a32f39f3d29)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.604577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb27be5a-7a4e-43cf-8f83-1c4102d0e179 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 16 00:42:56.604921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27be5a-7a4e-43cf-8f83-1c4102d0e179 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 16 00:42:56 2022] GET /identity/v3/projects/3c4625f8f78c492a895e7a32f39f3d29 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:58.756249 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83be1-f156-4863-82e0-01ad71ca2844 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.756805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83be1-f156-4863-82e0-01ad71ca2844 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.756924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83be1-f156-4863-82e0-01ad71ca2844 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.760964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:42:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:58.766879 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b59c3-d50f-47fe-b7b1-9772b2969802 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.767361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b59c3-d50f-47fe-b7b1-9772b2969802 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.767451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b59c3-d50f-47fe-b7b1-9772b2969802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.788996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-8a8b59c3-d50f-47fe-b7b1-9772b2969802 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:58.790897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-8a8b59c3-d50f-47fe-b7b1-9772b2969802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:58.800917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:42:59.080107 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83be1-f156-4863-82e0-01ad71ca2844 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:59.092374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83be1-f156-4863-82e0-01ad71ca2844 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:59.096582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b93804-5113-4d0f-8e14-25b031012dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:59.097185 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b93804-5113-4d0f-8e14-25b031012dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:59.097467 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b93804-5113-4d0f-8e14-25b031012dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:59.097741 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b93804-5113-4d0f-8e14-25b031012dd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:59.105493 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b93804-5113-4d0f-8e14-25b031012dd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:59.107261 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b93804-5113-4d0f-8e14-25b031012dd8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:59.116748 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Oct 16 00:42:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:42:59.122916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b59c3-d50f-47fe-b7b1-9772b2969802 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:59.133517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b59c3-d50f-47fe-b7b1-9772b2969802 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:59.137862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75a32c-bf17-4c88-8217-bad03e586d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:59.138498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a32c-bf17-4c88-8217-bad03e586d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:59.138783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a32c-bf17-4c88-8217-bad03e586d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:59.139060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a32c-bf17-4c88-8217-bad03e586d90 admin admin] PATH_INFO: `/v3/users/39d9127a36484f1999634ad75717a07d` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:59.140478 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75a32c-bf17-4c88-8217-bad03e586d90 admin admin] RBAC: Authorizing `identity:get_user(user_id=39d9127a36484f1999634ad75717a07d)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:59.143510 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75a32c-bf17-4c88-8217-bad03e586d90 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:59.145105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Sun Oct 16 00:42:59 2022] GET /identity/v3/users/39d9127a36484f1999634ad75717a07d => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:01.385855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276754-0b1c-4050-a6b9-4028f037393e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.386416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276754-0b1c-4050-a6b9-4028f037393e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.386416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276754-0b1c-4050-a6b9-4028f037393e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.387739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:01.397892 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d914-68f8-49e4-ba03-a87cd94e87dd None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.398404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d914-68f8-49e4-ba03-a87cd94e87dd None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.398908 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d914-68f8-49e4-ba03-a87cd94e87dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.428000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-99b9d914-68f8-49e4-ba03-a87cd94e87dd None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:01.429257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-99b9d914-68f8-49e4-ba03-a87cd94e87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:01.431922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34ea85-e235-4b64-8656-3bc824c13fd7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.432203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34ea85-e235-4b64-8656-3bc824c13fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.432513 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34ea85-e235-4b64-8656-3bc824c13fd7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.433847 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:01.440040 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.440440 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.440782 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.486740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG passlib.handlers.bcrypt [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81418) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 16 00:43:01.487041 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG passlib.handlers.bcrypt [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81418) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 16 00:43:01.529587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:01.537538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:01.539529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:01.652966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:01.802030 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d914-68f8-49e4-ba03-a87cd94e87dd None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.832779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:01.935902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.952369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d914-68f8-49e4-ba03-a87cd94e87dd None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.994018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.994669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.994953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.995232 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.009020 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:02.018866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:02.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:02.022267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:02.026424 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.056810 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d8ad4-8954-4547-bba4-0238ca82bb12 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.059507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.109954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.111397 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.111848 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.112247 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.114051 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.116155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.130902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.sql.core [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:43:02.130902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:43:02.130902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [parameters: {'id': '2c5df131a003401296722a57256b7cd2', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:43:02.130902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:43:02.131950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:43:02.154000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:43:02.155678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application yield resource Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise self.value Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application session.commit() Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:43:02.158211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:43:02.160117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:43:02.162152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:43:02.164070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [parameters: {'id': '2c5df131a003401296722a57256b7cd2', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:43:02.166765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:02.168462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:43:02.170245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.171594 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250136f-f5fc-48cd-a326-75cad165e408 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.171735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 8/15] 10.222.0.23 () {60 vars in 1137 bytes} [Sun Oct 16 00:43:01 2022] POST /identity/v3/domains => generated 190 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:02.171735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.215950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.216696 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.217038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.217428 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.218206 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:02.218573 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.221328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.242126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:02.248950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.302520 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b83d-87b0-481e-9852-89b8009f6e23 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.351737 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.352270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.352914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.381846 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.383227 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff900b1b-1935-42c7-ae1e-777833407416 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.384612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:02.413112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:02.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:02.417600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:02.417600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:02.417600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:02.417600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:02.421235 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.425117 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.425919 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.426066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.426283 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] PATH_INFO: `/v3/users/39d9127a36484f1999634ad75717a07d` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.427470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] RBAC: Authorizing `identity:get_user(user_id=39d9127a36484f1999634ad75717a07d)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.429010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.430620 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/users/39d9127a36484f1999634ad75717a07d => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:02.440480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.455634 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.460495 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.558781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5df7-1649-4392-baaf-aad21d09a1f4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.572587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4617-a9e4-4390-8487-d6730a14e5af None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.604742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2765-f6ed-4c1a-9e9f-c27f11b14fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.605449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2765-f6ed-4c1a-9e9f-c27f11b14fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.605830 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2765-f6ed-4c1a-9e9f-c27f11b14fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.606192 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2765-f6ed-4c1a-9e9f-c27f11b14fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.606939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2765-f6ed-4c1a-9e9f-c27f11b14fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:02.607326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2765-f6ed-4c1a-9e9f-c27f11b14fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.608990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2765-f6ed-4c1a-9e9f-c27f11b14fb7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.615667 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.616439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.616786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.617139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.618532 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.620270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.622264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:02.629681 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.632143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:02.731684 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.757022 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc9cb8-3036-4521-8f9a-7a4b93c86b5c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.799658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc4813-ddf3-459b-94e9-de8cedb16ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.800522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4813-ddf3-459b-94e9-de8cedb16ee1 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.800874 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4813-ddf3-459b-94e9-de8cedb16ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.801217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4813-ddf3-459b-94e9-de8cedb16ee1 None admin] PATH_INFO: `/v3/domains/default/users/39d9127a36484f1999634ad75717a07d/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.803632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc4813-ddf3-459b-94e9-de8cedb16ee1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=39d9127a36484f1999634ad75717a07d, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.805353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc4813-ddf3-459b-94e9-de8cedb16ee1 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.951382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Sun Oct 16 00:43:02 2022] PUT /identity/v3/domains/default/users/39d9127a36484f1999634ad75717a07d/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:43:06.315270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ceb8-ab93-43c4-b172-4b065dd92cc8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.316262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ceb8-ab93-43c4-b172-4b065dd92cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.316761 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ceb8-ab93-43c4-b172-4b065dd92cc8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.318319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:06.334715 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5d5e-3a1b-4a38-9543-82f1f1c76d98 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.335224 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5d5e-3a1b-4a38-9543-82f1f1c76d98 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.335705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5d5e-3a1b-4a38-9543-82f1f1c76d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.342802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398cdce-f87d-4bbf-8c40-55ba5baed2f8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.343427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398cdce-f87d-4bbf-8c40-55ba5baed2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.344508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398cdce-f87d-4bbf-8c40-55ba5baed2f8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.346350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:06.352383 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d33e0-1498-4301-b712-c80ae0ebb250 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.353007 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d33e0-1498-4301-b712-c80ae0ebb250 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.353488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d33e0-1498-4301-b712-c80ae0ebb250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.376004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5d9d33e0-1498-4301-b712-c80ae0ebb250 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:06.377801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5d9d33e0-1498-4301-b712-c80ae0ebb250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:06.386411 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-bb8d5d5e-3a1b-4a38-9543-82f1f1c76d98 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:06.392401 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-bb8d5d5e-3a1b-4a38-9543-82f1f1c76d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:06.541211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 13/24] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:06.585476 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:06.889638 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105e91-a63e-487d-9031-6b3576b9d31d None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.891125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105e91-a63e-487d-9031-6b3576b9d31d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.891954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105e91-a63e-487d-9031-6b3576b9d31d None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.894997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 14/26] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:06.901335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c013-d41b-45ea-b33a-8d179c075add None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.902213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c013-d41b-45ea-b33a-8d179c075add None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.902893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c013-d41b-45ea-b33a-8d179c075add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.942568 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-1339c013-d41b-45ea-b33a-8d179c075add None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:06.945237 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1339c013-d41b-45ea-b33a-8d179c075add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:06.995961 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105e91-a63e-487d-9031-6b3576b9d31d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.032848 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.184989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.197428 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:07.198780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c013-d41b-45ea-b33a-8d179c075add None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.337833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105e91-a63e-487d-9031-6b3576b9d31d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.425665 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4ec8-9627-4a11-ad4b-91cc99ed654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.426340 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4ec8-9627-4a11-ad4b-91cc99ed654d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.426629 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4ec8-9627-4a11-ad4b-91cc99ed654d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.426909 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4ec8-9627-4a11-ad4b-91cc99ed654d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.442297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c013-d41b-45ea-b33a-8d179c075add None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.461207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a4ec8-9627-4a11-ad4b-91cc99ed654d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.462736 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a4ec8-9627-4a11-ad4b-91cc99ed654d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-145a4ec8-9627-4a11-ad4b-91cc99ed654d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:07.491269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:07.492188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:07.493048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:07.493048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:07.493048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:07.495497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bea0a-a52c-4798-b6eb-84ad58b8883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.496422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bea0a-a52c-4798-b6eb-84ad58b8883b None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.496908 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bea0a-a52c-4798-b6eb-84ad58b8883b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.497547 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bea0a-a52c-4798-b6eb-84ad58b8883b None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.498438 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bea0a-a52c-4798-b6eb-84ad58b8883b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.501035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bea0a-a52c-4798-b6eb-84ad58b8883b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.503612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 15/28] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 509 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:07.507063 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679353f-6d1f-4c44-aa20-aa29d567fa09 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.507840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679353f-6d1f-4c44-aa20-aa29d567fa09 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.508361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679353f-6d1f-4c44-aa20-aa29d567fa09 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 16/29] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:07.515188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679353f-6d1f-4c44-aa20-aa29d567fa09 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.541695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 14/30] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 16 00:43:07 2022] POST /identity/v3/roles => generated 219 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:07.543765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245403d3-65e2-4643-94bd-b09be0639372 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.544501 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245403d3-65e2-4643-94bd-b09be0639372 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.544982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245403d3-65e2-4643-94bd-b09be0639372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.580677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-245403d3-65e2-4643-94bd-b09be0639372 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:07.583106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-245403d3-65e2-4643-94bd-b09be0639372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:07.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.716797 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.745796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 15/31] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:07.747164 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245403d3-65e2-4643-94bd-b09be0639372 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679353f-6d1f-4c44-aa20-aa29d567fa09 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.900470 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.901119 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.901404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.901680 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.902355 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:07.902662 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.904073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.937100 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:07.941674 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.961214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245403d3-65e2-4643-94bd-b09be0639372 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.016212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a22d9-a374-4743-a6e1-bcf1663175e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.016950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a22d9-a374-4743-a6e1-bcf1663175e5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.017958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a22d9-a374-4743-a6e1-bcf1663175e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.018265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a22d9-a374-4743-a6e1-bcf1663175e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.036808 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a22d9-a374-4743-a6e1-bcf1663175e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-fb2a22d9-a374-4743-a6e1-bcf1663175e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:08.043281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:08.044169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:08.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 16/33] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:08.047721 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166898-c981-4be8-a06f-5afd837c8151 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.048017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166898-c981-4be8-a06f-5afd837c8151 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.048386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166898-c981-4be8-a06f-5afd837c8151 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.050123 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 17/34] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:08.056547 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166898-c981-4be8-a06f-5afd837c8151 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.120849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f46ae-6fbe-4500-ac76-45f7105c2564 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.136885 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:08.149860 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:08.167982 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.168649 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.168934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.169212 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.169875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.171393 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.199541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166898-c981-4be8-a06f-5afd837c8151 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.237096 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb78e9e-cdee-4c3b-82cc-d60204ac5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.237711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78e9e-cdee-4c3b-82cc-d60204ac5a60 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.237996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78e9e-cdee-4c3b-82cc-d60204ac5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.238269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78e9e-cdee-4c3b-82cc-d60204ac5a60 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.238935 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78e9e-cdee-4c3b-82cc-d60204ac5a60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:08.239242 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78e9e-cdee-4c3b-82cc-d60204ac5a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.240682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78e9e-cdee-4c3b-82cc-d60204ac5a60 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.248959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 18/35] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:08.250204 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3faa-1cc1-4ebd-9b88-3629a46ec682 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.250494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3faa-1cc1-4ebd-9b88-3629a46ec682 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.250769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3faa-1cc1-4ebd-9b88-3629a46ec682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.269493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-3ded3faa-1cc1-4ebd-9b88-3629a46ec682 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:08.270675 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-3ded3faa-1cc1-4ebd-9b88-3629a46ec682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:08.309723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 18/36] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:07 2022] POST /identity/v3/projects => generated 301 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:08.310755 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.343140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:08.345188 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc47eb-d09e-4229-a7c7-0c01b872a2c3 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.345484 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc47eb-d09e-4229-a7c7-0c01b872a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.345764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc47eb-d09e-4229-a7c7-0c01b872a2c3 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.347074 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 20/38] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:08.347798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc47eb-d09e-4229-a7c7-0c01b872a2c3 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.396869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:08.443725 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01fa83-3b23-473a-8373-520ecbfc0f00 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.489881 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6b883-f70f-437a-8361-f6bd273949a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.490453 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b883-f70f-437a-8361-f6bd273949a1 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.490745 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b883-f70f-437a-8361-f6bd273949a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.491028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b883-f70f-437a-8361-f6bd273949a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.491547 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc47eb-d09e-4229-a7c7-0c01b872a2c3 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.491982 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6b883-f70f-437a-8361-f6bd273949a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.493340 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6b883-f70f-437a-8361-f6bd273949a1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.520348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 16 00:43:08 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:08.520348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96ea87-96f8-4f47-b223-47990fc0c305 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.520348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96ea87-96f8-4f47-b223-47990fc0c305 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.520348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96ea87-96f8-4f47-b223-47990fc0c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.541407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6d96ea87-96f8-4f47-b223-47990fc0c305 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:08.543270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6d96ea87-96f8-4f47-b223-47990fc0c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:08.579262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:08.634939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:08.658960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96ea87-96f8-4f47-b223-47990fc0c305 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.690202 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.691270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.691825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.692121 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] PATH_INFO: `/v3/users/39d9127a36484f1999634ad75717a07d` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.693583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] RBAC: Authorizing `identity:get_user(user_id=39d9127a36484f1999634ad75717a07d)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.695795 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.698901 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 21/41] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:08 2022] GET /identity/v3/users/39d9127a36484f1999634ad75717a07d => generated 247 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:08.705880 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.791294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96ea87-96f8-4f47-b223-47990fc0c305 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.840980 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674abde6-a580-4d8e-adee-8593a03860c9 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.842025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.842915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.844464 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.844781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.849109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.851020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.853059 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 21/42] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:08.854457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:08.860391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.881925 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.882578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.882869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.883157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.884341 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.885846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.892493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:08.893364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.898956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:08.973854 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf0bdd-7ec6-487f-a16e-b68ece5840eb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.995714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133399d-7339-429f-89f9-4b31fcce608e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:09.007945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:09.008657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:09.008876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:09.009151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:09.009812 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:09.011276 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:09.029304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e7ba6-26a3-4ac0-bc6c-f373fbc3952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:09.030088 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e7ba6-26a3-4ac0-bc6c-f373fbc3952c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:09.030425 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e7ba6-26a3-4ac0-bc6c-f373fbc3952c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:09.030641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e7ba6-26a3-4ac0-bc6c-f373fbc3952c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:09.032049 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e7ba6-26a3-4ac0-bc6c-f373fbc3952c None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.domain.id=default, user.id=39d9127a36484f1999634ad75717a07d) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:09.032390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e7ba6-26a3-4ac0-bc6c-f373fbc3952c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:09.033867 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e7ba6-26a3-4ac0-bc6c-f373fbc3952c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:09.039541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:08 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:43:09.040401 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:09.041582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 23/45] 10.222.0.23 () {56 vars in 1322 bytes} [Sun Oct 16 00:43:08 2022] GET /identity/v3/role_assignments?user.id=39d9127a36484f1999634ad75717a07d&scope.domain.id=default&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:09.150001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:09.170221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05f3d-5143-4244-a120-961eeb0a8fbf None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:09.214709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e0f14-ae5c-4205-9a44-8fcfde7f7a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:09.215359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0f14-ae5c-4205-9a44-8fcfde7f7a42 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:09.215646 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0f14-ae5c-4205-9a44-8fcfde7f7a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:09.215930 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0f14-ae5c-4205-9a44-8fcfde7f7a42 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:09.216680 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e0f14-ae5c-4205-9a44-8fcfde7f7a42 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:09.218150 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e0f14-ae5c-4205-9a44-8fcfde7f7a42 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:09.238293 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 16 00:43:09 2022] POST /identity/v3/roles => generated 223 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:11.275686 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc73cf-ce2d-4d48-8231-fde86993777f None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.276227 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc73cf-ce2d-4d48-8231-fde86993777f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.276227 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc73cf-ce2d-4d48-8231-fde86993777f None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.277628 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:11.283451 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530ab70-bb5e-409c-88fb-197bc8b7e5c4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530ab70-bb5e-409c-88fb-197bc8b7e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.284020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530ab70-bb5e-409c-88fb-197bc8b7e5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.301854 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e530ab70-bb5e-409c-88fb-197bc8b7e5c4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:11.303057 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e530ab70-bb5e-409c-88fb-197bc8b7e5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:11.368244 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:11.642636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc73cf-ce2d-4d48-8231-fde86993777f None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:11.686914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:11.744921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc73cf-ce2d-4d48-8231-fde86993777f None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:11.777819 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759612b-3bae-495b-afd7-d5ed51b5b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:11.778443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759612b-3bae-495b-afd7-d5ed51b5b3fb None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.778722 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759612b-3bae-495b-afd7-d5ed51b5b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.778992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759612b-3bae-495b-afd7-d5ed51b5b3fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.780101 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759612b-3bae-495b-afd7-d5ed51b5b3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:11.782125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759612b-3bae-495b-afd7-d5ed51b5b3fb None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:11.783673 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:11.789306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530ab70-bb5e-409c-88fb-197bc8b7e5c4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:11.861541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:11.886669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530ab70-bb5e-409c-88fb-197bc8b7e5c4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:11.920490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bbaa2-6fa6-46c8-bded-722885ed6d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:11.921022 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbaa2-6fa6-46c8-bded-722885ed6d98 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.921304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbaa2-6fa6-46c8-bded-722885ed6d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.921597 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbaa2-6fa6-46c8-bded-722885ed6d98 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.922833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bbaa2-6fa6-46c8-bded-722885ed6d98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:11.924302 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bbaa2-6fa6-46c8-bded-722885ed6d98 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:11.948804 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Oct 16 00:43:11 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:14.132970 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3eff8-ac37-49ac-8725-fe6d315d21a3 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.133527 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3eff8-ac37-49ac-8725-fe6d315d21a3 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.133527 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3eff8-ac37-49ac-8725-fe6d315d21a3 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.134859 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 26/51] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:14.140281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d67fd-3b82-4d19-91d9-8cb30e72b917 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.140910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d67fd-3b82-4d19-91d9-8cb30e72b917 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.140910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d67fd-3b82-4d19-91d9-8cb30e72b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.264238 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7a7d67fd-3b82-4d19-91d9-8cb30e72b917 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:14.266081 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7a7d67fd-3b82-4d19-91d9-8cb30e72b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:14.341667 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:14.613430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3eff8-ac37-49ac-8725-fe6d315d21a3 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:14.721516 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3eff8-ac37-49ac-8725-fe6d315d21a3 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:14.733464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:14.760307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507806-2178-4ccd-b1e7-e62567e95bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:14.761143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507806-2178-4ccd-b1e7-e62567e95bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.761469 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507806-2178-4ccd-b1e7-e62567e95bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.761788 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507806-2178-4ccd-b1e7-e62567e95bf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.763008 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507806-2178-4ccd-b1e7-e62567e95bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:14.764542 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507806-2178-4ccd-b1e7-e62567e95bf2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:14.766665 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:14.772507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d67fd-3b82-4d19-91d9-8cb30e72b917 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:14.834668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:14.884894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d67fd-3b82-4d19-91d9-8cb30e72b917 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:14.942029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7932b4-4510-487c-9efa-5f56624898e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:14.943093 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7932b4-4510-487c-9efa-5f56624898e9 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.943599 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7932b4-4510-487c-9efa-5f56624898e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.944094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7932b4-4510-487c-9efa-5f56624898e9 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.945316 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7932b4-4510-487c-9efa-5f56624898e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:14.948073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7932b4-4510-487c-9efa-5f56624898e9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:14.987759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 27/54] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:14 2022] POST /identity/v3/users => generated 275 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:43:19.911302 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d6ba-55ad-4d9d-99d9-4e64d80144e8 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:19.912427 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d6ba-55ad-4d9d-99d9-4e64d80144e8 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:19.912936 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d6ba-55ad-4d9d-99d9-4e64d80144e8 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:19.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 28/55] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:19.920858 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0047d-1353-4ec5-b3f5-ee4ab7c9dc25 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:19.921947 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0047d-1353-4ec5-b3f5-ee4ab7c9dc25 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:19.922439 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0047d-1353-4ec5-b3f5-ee4ab7c9dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:19.947842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1ae0047d-1353-4ec5-b3f5-ee4ab7c9dc25 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:19.949541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1ae0047d-1353-4ec5-b3f5-ee4ab7c9dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:19.985757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24333af-1134-4db4-812f-f61d373c81ee None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:19.986730 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24333af-1134-4db4-812f-f61d373c81ee None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:19.987500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24333af-1134-4db4-812f-f61d373c81ee None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:19.990500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 29/56] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:20.000595 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac9c3-e0fa-4054-9bd5-3db0bf387381 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:20.001503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac9c3-e0fa-4054-9bd5-3db0bf387381 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:20.002494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac9c3-e0fa-4054-9bd5-3db0bf387381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:20.033723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 28/57] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:20.038325 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-959ac9c3-e0fa-4054-9bd5-3db0bf387381 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:20.041076 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-959ac9c3-e0fa-4054-9bd5-3db0bf387381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:20.173196 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:20.410034 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47561a8-e202-4ed5-b018-78440bdec4ac None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:20.410554 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47561a8-e202-4ed5-b018-78440bdec4ac None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:20.411000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47561a8-e202-4ed5-b018-78440bdec4ac None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:20.412537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 29/59] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:20.421201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b7447-3b0d-47c7-8e4e-d58278b79eb2 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:20.422211 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b7447-3b0d-47c7-8e4e-d58278b79eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:20.422707 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b7447-3b0d-47c7-8e4e-d58278b79eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:20.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47561a8-e202-4ed5-b018-78440bdec4ac None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:20.465871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-bf9b7447-3b0d-47c7-8e4e-d58278b79eb2 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:20.467740 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-bf9b7447-3b0d-47c7-8e4e-d58278b79eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:20.596877 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:20.667919 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:20.691161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1acb-290f-47b9-aa3d-eb543d9a89de None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:20.692037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1acb-290f-47b9-aa3d-eb543d9a89de None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:20.692822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1acb-290f-47b9-aa3d-eb543d9a89de None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:20.695671 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 32/61] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:20.704532 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361563b8-191b-4ed3-a3ce-edad9036fe00 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:20.705420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361563b8-191b-4ed3-a3ce-edad9036fe00 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:20.706339 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361563b8-191b-4ed3-a3ce-edad9036fe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:20.724596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47561a8-e202-4ed5-b018-78440bdec4ac None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:20.743011 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-361563b8-191b-4ed3-a3ce-edad9036fe00 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:20.745554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-361563b8-191b-4ed3-a3ce-edad9036fe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:20.797620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:20.799141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:20.800192 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:20.800957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:20.807718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:20.827764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:20.842746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:20.845778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:20.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:20.851961 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 30/62] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:20.853833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:20.896833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:20.898767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361563b8-191b-4ed3-a3ce-edad9036fe00 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.066868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199452d0-f55b-4b61-ae68-c6ebf0577c57 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.071562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.111505 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361563b8-191b-4ed3-a3ce-edad9036fe00 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.138220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2620ff-a7c5-49e4-a2d1-5a91f45c1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.139709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2620ff-a7c5-49e4-a2d1-5a91f45c1117 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.141023 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2620ff-a7c5-49e4-a2d1-5a91f45c1117 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.141743 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2620ff-a7c5-49e4-a2d1-5a91f45c1117 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.162241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2620ff-a7c5-49e4-a2d1-5a91f45c1117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9b2620ff-a7c5-49e4-a2d1-5a91f45c1117 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:21.170313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:21.172800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:21.174524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 31/64] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:21.177784 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f5bc5-839e-4645-8e7d-4551956573d4 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.178080 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f5bc5-839e-4645-8e7d-4551956573d4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.178364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f5bc5-839e-4645-8e7d-4551956573d4 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.187225 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 32/65] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:21.187225 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f5bc5-839e-4645-8e7d-4551956573d4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.200810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.201856 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.202317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.204077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.210164 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:21.210164 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:21.213400 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:21.230659 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 34/66] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:21.232651 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.277431 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.359709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f5bc5-839e-4645-8e7d-4551956573d4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.400191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef377368-e4d8-4092-9b6d-beec8c181f39 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.418897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.419980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.420516 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.421015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.442119 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccbb3b-b83c-4fd5-a3ee-8444cb43a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.442745 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccbb3b-b83c-4fd5-a3ee-8444cb43a721 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.443022 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccbb3b-b83c-4fd5-a3ee-8444cb43a721 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.443293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccbb3b-b83c-4fd5-a3ee-8444cb43a721 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.443420 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:21.443968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccbb3b-b83c-4fd5-a3ee-8444cb43a721 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:21.444480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccbb3b-b83c-4fd5-a3ee-8444cb43a721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:21.445903 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccbb3b-b83c-4fd5-a3ee-8444cb43a721 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:21.454628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:21.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:21.456517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:21.457118 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 35/67] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:21.458024 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 33/68] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:21.459804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9b40-5adb-4abe-8f02-d34f68fa57f1 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.460093 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9b40-5adb-4abe-8f02-d34f68fa57f1 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.460745 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.461565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9b40-5adb-4abe-8f02-d34f68fa57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.488024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-0f5f9b40-5adb-4abe-8f02-d34f68fa57f1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:21.491635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-0f5f9b40-5adb-4abe-8f02-d34f68fa57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:21.495813 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.586895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:21.588111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9b40-5adb-4abe-8f02-d34f68fa57f1 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.612698 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee17f4-a864-4ceb-8767-f717f2729514 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.638728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.692116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.693076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.693615 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.694141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] PATH_INFO: `/v3/users/6608c88ccfcd49c99cc0f587051254fa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.722267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] RBAC: Authorizing `identity:get_user(user_id=6608c88ccfcd49c99cc0f587051254fa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:21.723873 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:21.733322 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 34/70] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/users/6608c88ccfcd49c99cc0f587051254fa => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:21.733322 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.776806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9b40-5adb-4abe-8f02-d34f68fa57f1 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.838122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.839123 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.839580 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.840033 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.854767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:21.860582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:21.862494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 37/71] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:21.864629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.915463 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.960266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9e033-b358-452d-afc8-041d6de18872 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.977228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.004475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.005332 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.005613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.005888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] PATH_INFO: `/v3/users/39d9127a36484f1999634ad75717a07d` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.007028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf526d-9ff3-4a7f-a5ad-eb5aba4b6f6b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.007704 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] RBAC: Authorizing `identity:get_user(user_id=39d9127a36484f1999634ad75717a07d)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.010345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.012611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 35/72] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/users/39d9127a36484f1999634ad75717a07d => generated 247 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.013415 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.071385 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.072271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.072673 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.073043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.074028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:22.074535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.076526 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.091020 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 38/73] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.092634 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.184262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cac51-6b42-4966-a036-11168d6d4f9a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.230408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.231175 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.231565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.231991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.233496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.235315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.240378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 36/74] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.240378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.252897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f4de-7f37-4b68-a7c0-2149d58fb262 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.261514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.298374 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.299261 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.299632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.300037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.300934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:22.301418 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.303086 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.313965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 39/75] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.315381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.331677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.371232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f401-d4e9-45d5-bb3b-d97d3b651cd4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.417668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.418635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.419101 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.419578 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.421503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.424087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.426364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 37/76] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.427772 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.468900 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df2ca-dc3d-4206-a3de-b48fc750fce8 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.512003 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.513047 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.513504 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.513967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.516304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.518821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.527525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 40/77] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.527525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.548479 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.570967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16081b-fe6a-4b97-817f-86377388072f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.624527 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.625551 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.625859 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.626247 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] PATH_INFO: `/v3/users/6608c88ccfcd49c99cc0f587051254fa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.627624 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] RBAC: Authorizing `identity:get_user(user_id=6608c88ccfcd49c99cc0f587051254fa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.629655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.631535 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 38/78] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/users/6608c88ccfcd49c99cc0f587051254fa => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.632912 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.635429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.665997 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edb829-bdfc-44a4-ab3e-5ba830d0cd6a None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.708662 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.709811 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.710197 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.710566 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/6608c88ccfcd49c99cc0f587051254fa/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.713018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6e200cbb14521a279711e4a298e21, user_id=6608c88ccfcd49c99cc0f587051254fa, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.714635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.731956 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 41/79] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:22 2022] PUT /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/6608c88ccfcd49c99cc0f587051254fa/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:22.733305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.768836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459db74c-32de-48dd-b102-98e21a3ae088 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.819671 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.820756 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.821128 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.821465 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] PATH_INFO: `/v3/users/6608c88ccfcd49c99cc0f587051254fa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.823015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] RBAC: Authorizing `identity:get_user(user_id=6608c88ccfcd49c99cc0f587051254fa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.824759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.826738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 39/80] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/users/6608c88ccfcd49c99cc0f587051254fa => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.828186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.865330 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.920045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed769fe-2b4e-4008-943d-61eaadf979eb None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.983171 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76e58-9db7-43ab-8e69-0b926fd5263d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.983427 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.984088 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.984534 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.984937 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.985838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.987608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.004001 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:23.043348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 42/81] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:22 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:23.045629 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.046991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.047491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.047982 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/39d9127a36484f1999634ad75717a07d/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.051519 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6e200cbb14521a279711e4a298e21, user_id=39d9127a36484f1999634ad75717a07d, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.053025 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.054170 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.089749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 40/82] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:22 2022] PUT /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/39d9127a36484f1999634ad75717a07d/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:23.091358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.347828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:23.366571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f099d-e47c-4b51-9dd2-b63840bf6bef None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.395372 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc97ea8-8da3-4b37-a58c-e1bde5cc9b2e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.456163 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.457467 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.458006 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.458507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] PATH_INFO: `/v3/projects/1ffb9692d3074be79eac23e70203fab3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.463597 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] RBAC: Authorizing `identity:get_project(project_id=1ffb9692d3074be79eac23e70203fab3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.465633 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.466305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.466548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.466702 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.466869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.469093 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.470729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 41/83] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:23 2022] GET /identity/v3/projects/1ffb9692d3074be79eac23e70203fab3 => generated 312 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:23.471062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.473027 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 43/84] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:23 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:23.479914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.480145 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.566597 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:23.641231 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a16c0b-bebb-4b57-8372-fe26645a16f5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.694229 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603840-98f2-4c11-a4e4-a63b6eee4896 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.735429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab47a-d981-4e01-8009-53c4e3a307d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.737663 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab47a-d981-4e01-8009-53c4e3a307d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.738399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab47a-d981-4e01-8009-53c4e3a307d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.739464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab47a-d981-4e01-8009-53c4e3a307d9 None admin] PATH_INFO: `/v3/projects/1ffb9692d3074be79eac23e70203fab3/users/6608c88ccfcd49c99cc0f587051254fa/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.744837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab47a-d981-4e01-8009-53c4e3a307d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ffb9692d3074be79eac23e70203fab3, user_id=6608c88ccfcd49c99cc0f587051254fa, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.749071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab47a-d981-4e01-8009-53c4e3a307d9 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618f6a9-640e-47dd-8668-8ed692b0417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.753867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f6a9-640e-47dd-8668-8ed692b0417d None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.754281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f6a9-640e-47dd-8668-8ed692b0417d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.754667 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f6a9-640e-47dd-8668-8ed692b0417d None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/6608c88ccfcd49c99cc0f587051254fa/roles/f2f3c5ec3295469bbeae5d990f1a59ae` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.757628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618f6a9-640e-47dd-8668-8ed692b0417d None admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6e200cbb14521a279711e4a298e21, user_id=6608c88ccfcd49c99cc0f587051254fa, role_id=f2f3c5ec3295469bbeae5d990f1a59ae)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.759060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618f6a9-640e-47dd-8668-8ed692b0417d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.783893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 44/85] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:23 2022] PUT /identity/v3/projects/1ffb9692d3074be79eac23e70203fab3/users/6608c88ccfcd49c99cc0f587051254fa/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:43:23.798208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 42/86] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:23 2022] PUT /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/6608c88ccfcd49c99cc0f587051254fa/roles/f2f3c5ec3295469bbeae5d990f1a59ae => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:25.975403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31a39-2796-4fdc-9e2c-a9f4ba8fa9e0 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:25.976334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31a39-2796-4fdc-9e2c-a9f4ba8fa9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:25.976771 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31a39-2796-4fdc-9e2c-a9f4ba8fa9e0 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:25.978751 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 45/87] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:25.985405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb88be-f547-4039-ae2d-6acf383504af None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:25.986306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb88be-f547-4039-ae2d-6acf383504af None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:25.986740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb88be-f547-4039-ae2d-6acf383504af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.021590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-04eb88be-f547-4039-ae2d-6acf383504af None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:26.023099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-04eb88be-f547-4039-ae2d-6acf383504af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:26.025620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:26.135145 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 43/88] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:26.840060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6888862-5586-461d-bb5d-83e1b6c211ee None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.840829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6888862-5586-461d-bb5d-83e1b6c211ee None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.841369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6888862-5586-461d-bb5d-83e1b6c211ee None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.843889 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 46/89] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:26.856508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ecbc-7119-4877-b4ed-5051c8bfb4eb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.857130 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ecbc-7119-4877-b4ed-5051c8bfb4eb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.857615 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ecbc-7119-4877-b4ed-5051c8bfb4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.865321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6888862-5586-461d-bb5d-83e1b6c211ee None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.887945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3765ecbc-7119-4877-b4ed-5051c8bfb4eb None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:26.889729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3765ecbc-7119-4877-b4ed-5051c8bfb4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:26.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 44/90] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:27.110020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515c95-a19e-4314-be4d-2d9857645629 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.110368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515c95-a19e-4314-be4d-2d9857645629 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.110792 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515c95-a19e-4314-be4d-2d9857645629 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.113774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 45/91] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:27.123239 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97489520-3dbb-4871-b708-2a581dcfb7bd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.123729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97489520-3dbb-4871-b708-2a581dcfb7bd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.124233 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97489520-3dbb-4871-b708-2a581dcfb7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.160345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-97489520-3dbb-4871-b708-2a581dcfb7bd None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:27.160345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-97489520-3dbb-4871-b708-2a581dcfb7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:27.174591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6888862-5586-461d-bb5d-83e1b6c211ee None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.253126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.345460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.346581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.347054 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.347508 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.372345 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:27.378292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.379228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:27.380018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:27.381187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 47/92] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:27.393677 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.395376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.403059 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 46/93] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:27.545806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a0ba-84ae-4dff-9c09-bc104eff00c1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.546186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a0ba-84ae-4dff-9c09-bc104eff00c1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.546474 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a0ba-84ae-4dff-9c09-bc104eff00c1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.547896 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 47/94] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:27.556341 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc63c-2fc6-4bf6-bfb6-c33286d0c480 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.556660 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc63c-2fc6-4bf6-bfb6-c33286d0c480 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.556917 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc63c-2fc6-4bf6-bfb6-c33286d0c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.580011 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae24c47-3736-4715-8334-eb5ad1f02f65 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.590594 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fecbc63c-2fc6-4bf6-bfb6-c33286d0c480 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:27.591845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fecbc63c-2fc6-4bf6-bfb6-c33286d0c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:27.651996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.653458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.653458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.653458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.653993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:27.654310 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.656544 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.675622 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 48/95] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:27.684390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.751715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 48/96] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:27.759560 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.828709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc63c-2fc6-4bf6-bfb6-c33286d0c480 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.853314 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6d5a6-25fb-41e4-8c3b-1bbec5617d6a None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.902307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.902887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.903173 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.903445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] PATH_INFO: `/v3/users/6608c88ccfcd49c99cc0f587051254fa` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.904859 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] RBAC: Authorizing `identity:get_user(user_id=6608c88ccfcd49c99cc0f587051254fa)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.907037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.908774 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 49/97] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/users/6608c88ccfcd49c99cc0f587051254fa => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:27.914714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.059195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc63c-2fc6-4bf6-bfb6-c33286d0c480 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.086660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379bdd-08b8-47fd-ac38-e210537e2ae4 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.101231 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.103684 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5bff8-4723-45b7-9af0-186b010af65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.104839 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5bff8-4723-45b7-9af0-186b010af65b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.105485 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5bff8-4723-45b7-9af0-186b010af65b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.106625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5bff8-4723-45b7-9af0-186b010af65b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.107748 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.122361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5bff8-4723-45b7-9af0-186b010af65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-82b5bff8-4723-45b7-9af0-186b010af65b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:28.128902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:28.129878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:28.130679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:28.133346 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 49/98] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:28.135361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4634-733b-4a23-8e9e-1dad336c2398 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.135945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4634-733b-4a23-8e9e-1dad336c2398 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.136491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4634-733b-4a23-8e9e-1dad336c2398 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.138828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 50/99] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:28.139896 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e4634-733b-4a23-8e9e-1dad336c2398 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.140799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095dbf9-af03-40f0-8c94-80373757ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.141640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095dbf9-af03-40f0-8c94-80373757ffad None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.142106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095dbf9-af03-40f0-8c94-80373757ffad None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.142544 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095dbf9-af03-40f0-8c94-80373757ffad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.250821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095dbf9-af03-40f0-8c94-80373757ffad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.253262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095dbf9-af03-40f0-8c94-80373757ffad None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.287755 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e4634-733b-4a23-8e9e-1dad336c2398 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.326196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.326848 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.327126 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.327429 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.339159 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:28.345251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:28.347008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 51/100] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:28.349087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.377229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:28.379002 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7b5e6-630c-41af-aa2f-aaf2b5767986 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.379308 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7b5e6-630c-41af-aa2f-aaf2b5767986 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.379587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7b5e6-630c-41af-aa2f-aaf2b5767986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.401299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-68e7b5e6-630c-41af-aa2f-aaf2b5767986 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:28.403400 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-68e7b5e6-630c-41af-aa2f-aaf2b5767986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:28.408219 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.409961 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.464709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448f26-187f-47ac-b305-7b9519333c43 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.512362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.512550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 51/102] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:28.513266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.513736 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.514223 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.514591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfde10-2aaa-4cca-afa2-f6852c29f1bd None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.515568 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfde10-2aaa-4cca-afa2-f6852c29f1bd None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.515945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.516047 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfde10-2aaa-4cca-afa2-f6852c29f1bd None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.516471 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.519949 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 52/103] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:28.520133 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.520288 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfde10-2aaa-4cca-afa2-f6852c29f1bd None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.539121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 52/104] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.544999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.657755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfde10-2aaa-4cca-afa2-f6852c29f1bd None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.676186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf76d-b6e4-47ab-bc0d-da72d93df10d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.687971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.699221 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.699874 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.700158 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.700465 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.710397 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.716712 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:28.718274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce01350-de2d-40c7-92ad-7fb9dad3e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.718910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce01350-de2d-40c7-92ad-7fb9dad3e9bb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.719195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce01350-de2d-40c7-92ad-7fb9dad3e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.719477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce01350-de2d-40c7-92ad-7fb9dad3e9bb None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.720161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce01350-de2d-40c7-92ad-7fb9dad3e9bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.720505 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce01350-de2d-40c7-92ad-7fb9dad3e9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:28.721766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:28.722738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:28.723638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:28.724242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce01350-de2d-40c7-92ad-7fb9dad3e9bb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.725098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 53/105] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:28.725098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.733076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 53/106] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.734909 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014394-cfd6-4edf-8a1d-3d28a995d4a7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.735259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014394-cfd6-4edf-8a1d-3d28a995d4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.735484 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014394-cfd6-4edf-8a1d-3d28a995d4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.754852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-71014394-cfd6-4edf-8a1d-3d28a995d4a7 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:28.756430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-71014394-cfd6-4edf-8a1d-3d28a995d4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:28.834195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 54/107] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:28.835085 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71014394-cfd6-4edf-8a1d-3d28a995d4a7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.850298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0246f9-06ad-4794-8266-64e82eb64cb0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.898131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.898773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.899058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.899337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.900843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.909390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 54/108] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.909390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.974378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71014394-cfd6-4edf-8a1d-3d28a995d4a7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.976984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.997733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.019779 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.020487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.021296 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.021644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] PATH_INFO: `/v3/users/95d0e29e29b3482e86acbf6651aee38a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.038442 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] RBAC: Authorizing `identity:get_user(user_id=95d0e29e29b3482e86acbf6651aee38a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.040009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.047103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 55/109] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/users/95d0e29e29b3482e86acbf6651aee38a => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.047103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.058897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919c29-a288-41a4-a963-47ab69eaae2f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.104461 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.105081 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.105422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.105705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.106395 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:29.106707 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.108137 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.117559 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 55/110] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.118478 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.170934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e30e9-bf4e-4c56-b472-61db4e07b934 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.212616 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.213268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.213551 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.213830 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] PATH_INFO: `/v3/users/39d9127a36484f1999634ad75717a07d` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.215160 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] RBAC: Authorizing `identity:get_user(user_id=39d9127a36484f1999634ad75717a07d)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.216512 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.218225 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 56/111] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/users/39d9127a36484f1999634ad75717a07d => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.219076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.236714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c71b-ebd5-4dc4-af42-f086fe34b549 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.256110 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.269865 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.278722 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.279369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.279650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.279926 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.282877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.284934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.288041 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 56/112] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.288895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.347791 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b603b-afd5-4b6d-bac4-1511750b1569 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.384844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.385386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.385678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.385952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.386694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] RBAC: Adding query filter params (role.id=3dbfca88f6e14b6dbd68ed1234f982bd, scope.project.id=9cb6e200cbb14521a279711e4a298e21, user.id=6608c88ccfcd49c99cc0f587051254fa) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:29.387029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.388515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.398549 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 57/113] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/role_assignments?user.id=6608c88ccfcd49c99cc0f587051254fa&scope.project.id=9cb6e200cbb14521a279711e4a298e21&role.id=3dbfca88f6e14b6dbd68ed1234f982bd => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.399981 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.415990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484e6a-37a5-40ea-87f6-c47f7ce2b347 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.460810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.461477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.461751 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.462036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.463304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.465027 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.466941 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 57/114] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.467791 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.557978 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.610625 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66027ce-0949-4bd6-8c0b-5d9bab5beb55 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.627246 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.648106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285a52-ef2c-4a74-b1a3-4e6e330ebaee None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.687687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.689658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.690064 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.690493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] PATH_INFO: `/v3/users/6608c88ccfcd49c99cc0f587051254fa` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] RBAC: Authorizing `identity:get_user(user_id=6608c88ccfcd49c99cc0f587051254fa)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.694645 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.697475 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 58/115] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/users/6608c88ccfcd49c99cc0f587051254fa => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.698967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.739136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.741338 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.741804 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.742235 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.763391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:29.769136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:29.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 58/116] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:29.773613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.882626 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306763-a754-4eb6-b858-86fa5462e138 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.886952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae179-a007-417c-bb0a-be296b633177 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.923409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.923958 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.924254 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.924576 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.925241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.926827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.932162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.940927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.941988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.942457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.942948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.970438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 59/117] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:29 2022] POST /identity/v3/projects => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:29.970438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.970438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:30.051072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.053568 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.100556 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3739-eb7b-4282-b6d8-1509b0e96170 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:30.138878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:30.139578 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.140457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.140839 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/95d0e29e29b3482e86acbf6651aee38a/roles/421d8debd72541ae9e2cca388d31be34` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.143112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6e200cbb14521a279711e4a298e21, user_id=95d0e29e29b3482e86acbf6651aee38a, role_id=421d8debd72541ae9e2cca388d31be34)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.144630 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.172350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 60/118] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:29 2022] PUT /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21/users/95d0e29e29b3482e86acbf6651aee38a/roles/421d8debd72541ae9e2cca388d31be34 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:30.172350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:30.237027 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 59/119] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:30.237940 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:30.287499 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:30.332020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:30.408622 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe2365-8794-40da-aacb-8733bc3ff603 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:30.417597 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662550a9-cd2d-4487-b33f-17c45682fbb2 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:30.473706 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:30.474774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.475246 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.475714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.483011 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:30.484013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.484652 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.484963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.486082 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:30.486605 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.489060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.508214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 60/120] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:30.509757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:30.612365 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.615368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.696641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:30.710467 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c10f75-b962-464b-b8bd-7b9b40acf3bc None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:30.749883 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:30.777003 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:30.778276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.778934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.779602 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.781931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.784865 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.788399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 61/121] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:30 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:30.789781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:30.828081 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 61/122] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:30.830147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:30.995905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d91d0c-7559-4f63-97d6-c1ec1d4d4d0e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.018774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb2111-e746-435d-ba5f-092777a3b157 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.076176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.078035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.078877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.079671 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] PATH_INFO: `/v3/users/6608c88ccfcd49c99cc0f587051254fa` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.082098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] RBAC: Authorizing `identity:get_user(user_id=6608c88ccfcd49c99cc0f587051254fa)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.082321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.083318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.083853 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.084661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.086149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=9cb6e200cbb14521a279711e4a298e21, user.id=39d9127a36484f1999634ad75717a07d) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:31.086622 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.086776 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.089614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.090381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 62/123] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:30 2022] GET /identity/v3/users/6608c88ccfcd49c99cc0f587051254fa => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:31.092228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.109582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 62/124] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:30 2022] GET /identity/v3/role_assignments?user.id=39d9127a36484f1999634ad75717a07d&scope.project.id=9cb6e200cbb14521a279711e4a298e21&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:31.111262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.158443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.177885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.305410 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38349ccf-a19d-4222-b961-2f37ab88c9a4 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.344295 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd446c8-1d28-4690-9245-fdeedd38cbbb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.359797 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.360551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.360895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.361187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.362579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.364136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.366460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 63/125] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:31.372886 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.394300 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.394942 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.395273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.395557 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.518682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.525230 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4e5a-f2e5-4a29-84ab-66ae8882cc74 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.561371 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.565423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.572975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.573768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.574112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.574452 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.575411 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] RBAC: Adding query filter params (role.id=f2f3c5ec3295469bbeae5d990f1a59ae, scope.project.id=9cb6e200cbb14521a279711e4a298e21, user.id=6608c88ccfcd49c99cc0f587051254fa) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:31.575724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.577238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.585649 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 64/126] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/role_assignments?user.id=6608c88ccfcd49c99cc0f587051254fa&scope.project.id=9cb6e200cbb14521a279711e4a298e21&role.id=f2f3c5ec3295469bbeae5d990f1a59ae => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:31.639125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.796716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 63/127] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:31.806128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.954023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19f971-af2d-423e-8902-fe418ba2213f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.990699 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711b20-cf15-449a-8c15-4a81259501e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.991375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711b20-cf15-449a-8c15-4a81259501e3 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.991664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711b20-cf15-449a-8c15-4a81259501e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.991947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711b20-cf15-449a-8c15-4a81259501e3 None admin] PATH_INFO: `/v3/projects/1ffb9692d3074be79eac23e70203fab3` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.993173 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711b20-cf15-449a-8c15-4a81259501e3 None admin] RBAC: Authorizing `identity:get_project(project_id=1ffb9692d3074be79eac23e70203fab3)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.994668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711b20-cf15-449a-8c15-4a81259501e3 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.996613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 65/128] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/projects/1ffb9692d3074be79eac23e70203fab3 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:32.003225 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.114422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad973f-f5df-4e2a-8160-aad8a2a96df8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.145275 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.157072 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e227d5-f1f6-4b9a-b284-9b81856e1a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.157736 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e227d5-f1f6-4b9a-b284-9b81856e1a69 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.158020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e227d5-f1f6-4b9a-b284-9b81856e1a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.158303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e227d5-f1f6-4b9a-b284-9b81856e1a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.159442 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e227d5-f1f6-4b9a-b284-9b81856e1a69 None admin] RBAC: Adding query filter params (role.id=3dbfca88f6e14b6dbd68ed1234f982bd, scope.project.id=1ffb9692d3074be79eac23e70203fab3, user.id=6608c88ccfcd49c99cc0f587051254fa) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:32.159756 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e227d5-f1f6-4b9a-b284-9b81856e1a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.161298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e227d5-f1f6-4b9a-b284-9b81856e1a69 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.168422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 64/129] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/role_assignments?user.id=6608c88ccfcd49c99cc0f587051254fa&scope.project.id=1ffb9692d3074be79eac23e70203fab3&role.id=3dbfca88f6e14b6dbd68ed1234f982bd => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:32.537765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176da58-cba3-419e-83fb-4a9ebf2f2770 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.538293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176da58-cba3-419e-83fb-4a9ebf2f2770 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.538532 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176da58-cba3-419e-83fb-4a9ebf2f2770 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.541155 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 66/130] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:32.550861 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f590a-8ba1-4bc2-8e1b-d1995483cc77 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.551430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f590a-8ba1-4bc2-8e1b-d1995483cc77 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.551841 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f590a-8ba1-4bc2-8e1b-d1995483cc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.583821 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f74f590a-8ba1-4bc2-8e1b-d1995483cc77 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:32.586220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f74f590a-8ba1-4bc2-8e1b-d1995483cc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:32.660093 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e62f47-f080-44e0-aace-2f85869da96d None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.660511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e62f47-f080-44e0-aace-2f85869da96d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.660817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e62f47-f080-44e0-aace-2f85869da96d None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 67/131] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:32.670392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4fdc-db99-4c37-a4ef-b8b11ef3e5e3 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.670680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4fdc-db99-4c37-a4ef-b8b11ef3e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.670940 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4fdc-db99-4c37-a4ef-b8b11ef3e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.680025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 65/132] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:32.691201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-13ac4fdc-db99-4c37-a4ef-b8b11ef3e5e3 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:32.692443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-13ac4fdc-db99-4c37-a4ef-b8b11ef3e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:32.722849 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.776773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 68/133] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:32.962090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f590a-8ba1-4bc2-8e1b-d1995483cc77 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.049905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4fdc-db99-4c37-a4ef-b8b11ef3e5e3 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.078271 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f590a-8ba1-4bc2-8e1b-d1995483cc77 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.102847 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.117744 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.118394 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.118676 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.118958 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.131308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:33.136268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:33.138014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:33.139590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 66/134] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:33.143981 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.204277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4fdc-db99-4c37-a4ef-b8b11ef3e5e3 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.259180 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.259828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.260116 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.260437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.261641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.263124 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.265647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 69/135] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:33.271366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.297319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c1b72-1673-425e-aaa0-74157122b3c8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.304335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.348095 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.348754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.349052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.349323 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.350011 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:33.350326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.351762 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.360957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 67/136] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:33.366851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.417286 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.418611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dc363-f4bf-4eda-885f-bdedd36601e2 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.466403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.467034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.467321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.467602 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.468430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.469957 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.495774 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 70/137] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:33 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:43:33.520730 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841a023-3662-4ae0-a9de-198e21132a92 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.569065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.570116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.570532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.570952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] PATH_INFO: `/v3/users/95d0e29e29b3482e86acbf6651aee38a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.572583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] RBAC: Authorizing `identity:get_user(user_id=95d0e29e29b3482e86acbf6651aee38a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.574323 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.576398 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 68/138] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/users/95d0e29e29b3482e86acbf6651aee38a => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:33.583107 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.720991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.754370 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc60f4-a70a-4cc3-b8ce-580bae56f370 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.814573 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.815660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.816178 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.816731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.902251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.905163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.039731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.071463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 71/139] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:43:34.080567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.269356 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5016b3-63eb-40b5-91f0-a5b8ad4ef7ce None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.294650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.333777 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a9250-b2f4-4050-9a58-05f021faee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.335035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a9250-b2f4-4050-9a58-05f021faee70 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.335451 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a9250-b2f4-4050-9a58-05f021faee70 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.335908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a9250-b2f4-4050-9a58-05f021faee70 None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.337986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a9250-b2f4-4050-9a58-05f021faee70 None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.340654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a9250-b2f4-4050-9a58-05f021faee70 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.344422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 69/140] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:34.353796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.540838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ada9-ff13-4543-a14c-6e2a13be5cef None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.607460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e7509-a7e7-409a-a8e8-c4610f8aef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.611066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e7509-a7e7-409a-a8e8-c4610f8aef2c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.611836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e7509-a7e7-409a-a8e8-c4610f8aef2c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.612582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e7509-a7e7-409a-a8e8-c4610f8aef2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.614100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e7509-a7e7-409a-a8e8-c4610f8aef2c None admin] RBAC: Adding query filter params (role.id=421d8debd72541ae9e2cca388d31be34, scope.project.id=9cb6e200cbb14521a279711e4a298e21, user.id=95d0e29e29b3482e86acbf6651aee38a) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:34.614961 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e7509-a7e7-409a-a8e8-c4610f8aef2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.617997 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e7509-a7e7-409a-a8e8-c4610f8aef2c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.630307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 72/141] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/role_assignments?user.id=95d0e29e29b3482e86acbf6651aee38a&scope.project.id=9cb6e200cbb14521a279711e4a298e21&role.id=421d8debd72541ae9e2cca388d31be34 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:36.317867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25a5c-14a0-46be-85d1-7cde3b52ebef None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.318391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25a5c-14a0-46be-85d1-7cde3b52ebef None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.318498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25a5c-14a0-46be-85d1-7cde3b52ebef None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.319781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 70/142] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:36.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6e49f-1d5b-4d88-858a-8e335457ffde None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.326125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6e49f-1d5b-4d88-858a-8e335457ffde None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.326534 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6e49f-1d5b-4d88-858a-8e335457ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.358034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b1f6e49f-1d5b-4d88-858a-8e335457ffde None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:36.360253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b1f6e49f-1d5b-4d88-858a-8e335457ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:36.400036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f64a-1120-481f-a752-852d1c50aeb5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.400454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f64a-1120-481f-a752-852d1c50aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.400648 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f64a-1120-481f-a752-852d1c50aeb5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.402044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 71/143] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:36.408908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723e92a-ea44-443b-97d8-eb09dd8acea9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.408908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723e92a-ea44-443b-97d8-eb09dd8acea9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.409306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723e92a-ea44-443b-97d8-eb09dd8acea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.429496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a723e92a-ea44-443b-97d8-eb09dd8acea9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:36.430739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a723e92a-ea44-443b-97d8-eb09dd8acea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:36.449856 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.488504 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 73/144] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:36.555924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 72/145] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:36.585051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0c55a-3957-4307-943a-dd02a5f8e675 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.585324 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0c55a-3957-4307-943a-dd02a5f8e675 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.585650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0c55a-3957-4307-943a-dd02a5f8e675 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.587192 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 74/146] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:36.592753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a18f-7b0b-4e47-8822-dbbfb56f2bbd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.593087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a18f-7b0b-4e47-8822-dbbfb56f2bbd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.593368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a18f-7b0b-4e47-8822-dbbfb56f2bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.613004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9a25a18f-7b0b-4e47-8822-dbbfb56f2bbd None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:36.614210 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9a25a18f-7b0b-4e47-8822-dbbfb56f2bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:36.692747 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 73/147] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:36.759873 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0c55a-3957-4307-943a-dd02a5f8e675 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.897465 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0c55a-3957-4307-943a-dd02a5f8e675 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:36.939016 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.939293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.939564 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.951824 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:36.957398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:36.960799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:36.961783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 75/148] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:36.965926 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25a18f-7b0b-4e47-8822-dbbfb56f2bbd None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.969318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.016662 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.024238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.101717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25a18f-7b0b-4e47-8822-dbbfb56f2bbd None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.117859 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950863d-f82c-4250-868c-48dafa179f5e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.142849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.143854 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.144335 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.144799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.162273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:37.168910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.169855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.170295 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.170747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:37.171768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:37.173495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:37.174965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:37.176620 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.176620 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.176858 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 74/149] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:37.176978 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.177452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.189044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 76/150] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.190449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.307502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.311381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8918e-1cad-4261-b626-a14bde9689d2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.314778 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.320572 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae785dd-921a-45e5-a944-c607d4cdeaae None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.364478 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.365576 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.365942 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.366226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.366813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.367679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.367850 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.368122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.368508 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.369622 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.370477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.371144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.373510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 75/151] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.375857 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.386687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 77/152] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.386687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.514081 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052a0c8-9b4f-487e-a2d7-07f3d02151d1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.523711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05561b7-06f9-4976-940f-5e6cbbfdf5ba None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.557230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.558263 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.558694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.559198 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] PATH_INFO: `/v3/users/5d9641aaee484d39a823e34eeb5c2088` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.562925 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.563733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.564126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.564538 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.566894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.584676 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] RBAC: Authorizing `identity:get_user(user_id=5d9641aaee484d39a823e34eeb5c2088)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.587666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.595975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 78/153] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:37 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:37.596272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 76/154] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/users/5d9641aaee484d39a823e34eeb5c2088 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.596444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.598943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.634631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.649995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.778837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07879b-0949-44cc-a823-0ec7346f590c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.781276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7748e9-7b37-4b99-899f-4ae4d8ab3fae None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.838271 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.839333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.839879 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.840439 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.842514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.845400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.846547 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.847207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.847481 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.847756 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] PATH_INFO: `/v3/users/5d9641aaee484d39a823e34eeb5c2088` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.848571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 77/155] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] RBAC: Authorizing `identity:get_user(user_id=5d9641aaee484d39a823e34eeb5c2088)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.851262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.853221 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 79/156] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/users/5d9641aaee484d39a823e34eeb5c2088 => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.858092 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.858788 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.990803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:38.021150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0634e8-439e-4466-b0c3-d24445084c8e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.049650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:38.058906 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae17fee-84c7-4562-ac62-bffaa617a53d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.089000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.089703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.090038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.090450 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.091803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.094624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.097803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 80/157] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:38.108168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.110579 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e1a3c-5339-4a46-a993-ca67b32f9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.111713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1a3c-5339-4a46-a993-ca67b32f9666 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.112214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1a3c-5339-4a46-a993-ca67b32f9666 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.112724 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1a3c-5339-4a46-a993-ca67b32f9666 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/5d9641aaee484d39a823e34eeb5c2088/roles/f2f3c5ec3295469bbeae5d990f1a59ae` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.116787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e1a3c-5339-4a46-a993-ca67b32f9666 None admin] RBAC: Authorizing `identity:create_grant(project_id=8825efeeed9049cfa4f7e8fe43a3bddc, user_id=5d9641aaee484d39a823e34eeb5c2088, role_id=f2f3c5ec3295469bbeae5d990f1a59ae)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.119431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e1a3c-5339-4a46-a993-ca67b32f9666 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.144283 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 78/158] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:37 2022] PUT /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/5d9641aaee484d39a823e34eeb5c2088/roles/f2f3c5ec3295469bbeae5d990f1a59ae => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:38.270356 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c555e-d910-4c2e-afc2-cb4f04c3477e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.311568 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06357-aae1-41fb-8bfc-105a7d47bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.312336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06357-aae1-41fb-8bfc-105a7d47bef7 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.312612 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06357-aae1-41fb-8bfc-105a7d47bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.312936 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06357-aae1-41fb-8bfc-105a7d47bef7 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/5d9641aaee484d39a823e34eeb5c2088/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.315114 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06357-aae1-41fb-8bfc-105a7d47bef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8825efeeed9049cfa4f7e8fe43a3bddc, user_id=5d9641aaee484d39a823e34eeb5c2088, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.316760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06357-aae1-41fb-8bfc-105a7d47bef7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.335955 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 81/159] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:38 2022] PUT /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/5d9641aaee484d39a823e34eeb5c2088/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:40.051808 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79c135-7167-4839-8b07-a302708065a0 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.052390 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79c135-7167-4839-8b07-a302708065a0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.052390 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79c135-7167-4839-8b07-a302708065a0 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.053984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 79/160] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:40.061960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58217f6e-e863-4919-9a59-c02f03ca6d71 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.063403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58217f6e-e863-4919-9a59-c02f03ca6d71 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.064192 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58217f6e-e863-4919-9a59-c02f03ca6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.095677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-58217f6e-e863-4919-9a59-c02f03ca6d71 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:40.098050 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-58217f6e-e863-4919-9a59-c02f03ca6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:40.117439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.226829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 82/161] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:40.539479 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3968d68-7dbd-409c-8bf2-b506a01b801d None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.540656 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3968d68-7dbd-409c-8bf2-b506a01b801d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.541521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3968d68-7dbd-409c-8bf2-b506a01b801d None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.544684 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 80/162] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:40.551269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5f96d-e1be-416b-80b7-b6646f564d5f None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.551550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5f96d-e1be-416b-80b7-b6646f564d5f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.551851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5f96d-e1be-416b-80b7-b6646f564d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.571018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-3cd5f96d-e1be-416b-80b7-b6646f564d5f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:40.572244 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-3cd5f96d-e1be-416b-80b7-b6646f564d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:40.644248 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3968d68-7dbd-409c-8bf2-b506a01b801d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.659879 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 83/163] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:40.666587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5481f-eeca-402c-8700-e09b5c1cf88e None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.667224 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5481f-eeca-402c-8700-e09b5c1cf88e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.667508 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5481f-eeca-402c-8700-e09b5c1cf88e None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.669251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 84/164] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:40.676889 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a389f90-c5cf-45e6-86dc-9581202af6f6 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.677447 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a389f90-c5cf-45e6-86dc-9581202af6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.678100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a389f90-c5cf-45e6-86dc-9581202af6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.700687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-6a389f90-c5cf-45e6-86dc-9581202af6f6 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:40.702968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-6a389f90-c5cf-45e6-86dc-9581202af6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:40.793326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3968d68-7dbd-409c-8bf2-b506a01b801d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.838999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.839704 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.840014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.840347 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.856358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 85/165] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:40.856606 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:40.858960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:40.860709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:40.862299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 81/166] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:40.869791 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a389f90-c5cf-45e6-86dc-9581202af6f6 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.873522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.950623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.969034 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.001919 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a389f90-c5cf-45e6-86dc-9581202af6f6 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.040643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.041280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.041567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.041846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.042616 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:41.042927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.044570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.054567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 86/167] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:41.060222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.087533 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6c81-cef5-43aa-b736-fafce95b21d0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.127867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.129239 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.129523 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.129971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.143324 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:41.143699 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:41.152823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:41.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:41.165532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 82/168] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:41.165532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.190904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42edb-d5e9-4d70-b284-1992321294ef None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.237507 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.238401 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.238788 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.239255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] PATH_INFO: `/v3/users/1bd034fe27c844d7bcb0d3b823f939ff` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.250445 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.260976 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] RBAC: Authorizing `identity:get_user(user_id=1bd034fe27c844d7bcb0d3b823f939ff)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.262969 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.265946 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 87/169] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/users/1bd034fe27c844d7bcb0d3b823f939ff => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:41.274630 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.291092 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c520-db8f-47f8-93f2-56b874864662 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.346248 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.347247 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.347736 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.348214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.349154 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:41.350837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.352489 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.361805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 83/170] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:41.367587 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.432161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654dbfd-d84e-413e-880e-2cde0b48ae3c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.471046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.489961 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.491039 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.491508 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.491942 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.493909 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.496640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.500793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 88/171] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:41.501943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.520536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e447bd-d9a1-4e1d-981a-482e080f661c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.562262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.562993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.563274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.563550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] PATH_INFO: `/v3/users/5d9641aaee484d39a823e34eeb5c2088` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.564937 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] RBAC: Authorizing `identity:get_user(user_id=5d9641aaee484d39a823e34eeb5c2088)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.567292 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.569195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 84/172] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/users/5d9641aaee484d39a823e34eeb5c2088 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:41.573306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.580822 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.668060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec78a-1b8b-4670-a0b2-0edaf90afec0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.730252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.731176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92acaf3-2d86-4606-9d88-e52eb36ce717 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.731362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.731768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.732250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.734861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.737451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.740333 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 89/173] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:41.743194 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.789238 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.790354 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.790830 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.791311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/1bd034fe27c844d7bcb0d3b823f939ff/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.794570 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] RBAC: Authorizing `identity:create_grant(project_id=8825efeeed9049cfa4f7e8fe43a3bddc, user_id=1bd034fe27c844d7bcb0d3b823f939ff, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.797204 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.821121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 85/174] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:41 2022] PUT /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/1bd034fe27c844d7bcb0d3b823f939ff/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:41.823010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.887390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.953036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.962640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dafba-db92-464a-add6-011c4207c7d7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:42.011614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4ae6-7d95-4345-a1a5-158ec7b09acf None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:42.025950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:42.026970 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.027443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.027940 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.058785 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc9046-bb35-4a2d-9620-435646525b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:42.059672 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc9046-bb35-4a2d-9620-435646525b04 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.060102 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc9046-bb35-4a2d-9620-435646525b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.060756 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc9046-bb35-4a2d-9620-435646525b04 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.061699 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc9046-bb35-4a2d-9620-435646525b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:42.063982 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc9046-bb35-4a2d-9620-435646525b04 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:42.092117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 86/175] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:41 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:42.094592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f4464-cee7-4621-81ba-ae26c4829596 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.095046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f4464-cee7-4621-81ba-ae26c4829596 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.095470 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f4464-cee7-4621-81ba-ae26c4829596 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.097673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 87/176] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:42.108815 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce7fb-b889-46a6-9e54-528aec9e9ddd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.108815 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce7fb-b889-46a6-9e54-528aec9e9ddd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.108815 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce7fb-b889-46a6-9e54-528aec9e9ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.142804 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-743ce7fb-b889-46a6-9e54-528aec9e9ddd None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:42.144955 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-743ce7fb-b889-46a6-9e54-528aec9e9ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:42.152178 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:42.154402 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:42.236840 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:42.293413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 88/177] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:42.293977 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 90/178] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:42.303192 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ce7fb-b889-46a6-9e54-528aec9e9ddd None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:42.408807 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:42.510284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ce7fb-b889-46a6-9e54-528aec9e9ddd None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:42.577688 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:42.579303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.580029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.580771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.583320 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:42.586739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:42.590678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 89/179] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:42 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:42.600593 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:42.782448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:42.835827 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f317a9-b84d-4403-94b3-4fb2fcda746b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:42.893739 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:42.894454 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.894878 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.895254 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.895996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] RBAC: Adding query filter params (role.id=f2f3c5ec3295469bbeae5d990f1a59ae, scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc, user.id=5d9641aaee484d39a823e34eeb5c2088) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:42.896480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:42.898305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:42.908749 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 91/180] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:42 2022] GET /identity/v3/role_assignments?user.id=5d9641aaee484d39a823e34eeb5c2088&scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc&role.id=f2f3c5ec3295469bbeae5d990f1a59ae => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:43.043550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e1ed0-e8d1-482c-b1ae-1d39a632aafd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.080253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:43.108250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.109319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.109725 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.109979 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:43.134569 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:43.141220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:43.143993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:43.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 90/181] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:43.156552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.216718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:43.381412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ec16-6c11-4233-bcce-3da1cd847ce0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.434712 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.435343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.435625 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.435898 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:43.436674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:43.437197 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:43.438794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:43.451614 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 92/182] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:43.459483 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.664893 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba86b-22ff-48e7-b916-2b4df60d58ed None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.721152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.722099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.722552 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.722996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] PATH_INFO: `/v3/users/5d9641aaee484d39a823e34eeb5c2088` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:43.724402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] RBAC: Authorizing `identity:get_user(user_id=5d9641aaee484d39a823e34eeb5c2088)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:43.726139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:43.728299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 91/183] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/users/5d9641aaee484d39a823e34eeb5c2088 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:43.737704 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.848398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:43.869045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d19c0-7913-4ead-bea8-12cac3614e31 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.916245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.917354 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.917757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.918229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.007898 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.009860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.157095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.179587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 93/184] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:44.180668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.238055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.301142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc53a-c3fa-4a95-b895-8c95075e9157 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.339804 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbc2c1-ceda-47ed-96b2-109db4708103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.340488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc2c1-ceda-47ed-96b2-109db4708103 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.340767 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc2c1-ceda-47ed-96b2-109db4708103 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.341039 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc2c1-ceda-47ed-96b2-109db4708103 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.342246 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbc2c1-ceda-47ed-96b2-109db4708103 None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.343989 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbc2c1-ceda-47ed-96b2-109db4708103 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.345705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 92/185] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:44.355451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.549358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8720a-c515-4f3e-9d0d-131dc454574b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.591608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b4851-547a-4c39-b7b4-c21d6339aadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.592228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4851-547a-4c39-b7b4-c21d6339aadf None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.593064 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4851-547a-4c39-b7b4-c21d6339aadf None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.593353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4851-547a-4c39-b7b4-c21d6339aadf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.594293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b4851-547a-4c39-b7b4-c21d6339aadf None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc, user.id=5d9641aaee484d39a823e34eeb5c2088) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:44.594602 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b4851-547a-4c39-b7b4-c21d6339aadf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.596149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b4851-547a-4c39-b7b4-c21d6339aadf None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.601876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1ccd-1182-4e0f-8c1c-650ccfb87085 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.602211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1ccd-1182-4e0f-8c1c-650ccfb87085 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.602445 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1ccd-1182-4e0f-8c1c-650ccfb87085 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 94/186] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/role_assignments?user.id=5d9641aaee484d39a823e34eeb5c2088&scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:44.603845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 93/187] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:44.612772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a64e-e75f-4898-abd0-4d31b4593326 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.613146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a64e-e75f-4898-abd0-4d31b4593326 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.613367 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a64e-e75f-4898-abd0-4d31b4593326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.634548 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-85e6a64e-e75f-4898-abd0-4d31b4593326 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:44.635789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-85e6a64e-e75f-4898-abd0-4d31b4593326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:44.731180 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.774326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 95/188] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:45.170369 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1ccd-1182-4e0f-8c1c-650ccfb87085 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.304332 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1ccd-1182-4e0f-8c1c-650ccfb87085 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.322761 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.349055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d02217-8c76-426b-9014-c3ec7d77965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.349870 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02217-8c76-426b-9014-c3ec7d77965a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.350273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02217-8c76-426b-9014-c3ec7d77965a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.350686 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02217-8c76-426b-9014-c3ec7d77965a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.363940 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d02217-8c76-426b-9014-c3ec7d77965a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:45.368444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f38f-04be-456a-9c46-942f844a8094 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.369186 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f38f-04be-456a-9c46-942f844a8094 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.369186 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f38f-04be-456a-9c46-942f844a8094 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-55d02217-8c76-426b-9014-c3ec7d77965a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:45.370200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:45.371806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:45.376221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:45.378767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 96/189] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:45.379007 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 94/190] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:45.379491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2f38f-04be-456a-9c46-942f844a8094 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.381937 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a661765-d746-4f70-bbef-721c2758a8e2 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.382327 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a661765-d746-4f70-bbef-721c2758a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.382735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a661765-d746-4f70-bbef-721c2758a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.404177 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7a661765-d746-4f70-bbef-721c2758a8e2 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:45.405557 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7a661765-d746-4f70-bbef-721c2758a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:45.480414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 95/191] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:45.486598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d42f4-e880-4bb9-bf35-3de3ef0f9f98 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.487006 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d42f4-e880-4bb9-bf35-3de3ef0f9f98 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.487467 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d42f4-e880-4bb9-bf35-3de3ef0f9f98 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.490235 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 96/192] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:45.496074 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89c62-caac-410c-aa86-32db53955492 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.496363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89c62-caac-410c-aa86-32db53955492 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.496986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89c62-caac-410c-aa86-32db53955492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.508850 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2f38f-04be-456a-9c46-942f844a8094 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.518001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-76d89c62-caac-410c-aa86-32db53955492 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:45.519384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-76d89c62-caac-410c-aa86-32db53955492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:45.576252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.577387 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.577878 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.578333 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.579453 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:45.579993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.582640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.596744 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 97/193] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:45.606295 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.616160 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 97/194] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:45.687284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.753634 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d89c62-caac-410c-aa86-32db53955492 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.790850 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76d23-18d4-4771-a6b7-a491c5a080b0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.814838 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.847740 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.848566 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.848944 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.849536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] PATH_INFO: `/v3/users/1bd034fe27c844d7bcb0d3b823f939ff` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.851608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] RBAC: Authorizing `identity:get_user(user_id=1bd034fe27c844d7bcb0d3b823f939ff)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.854437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.862510 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 98/195] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/users/1bd034fe27c844d7bcb0d3b823f939ff => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:45.864481 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.931802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d89c62-caac-410c-aa86-32db53955492 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.969915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.970575 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.970852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.971130 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.972286 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.973790 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.975416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 98/196] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:45.975416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.018249 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b5708-84c0-4aca-bc51-9e7d729b8b7b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.031558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.069929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.071205 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.071626 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.071998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.119444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df1ae-37a9-40ca-9062-71c94752db98 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.121404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.171293 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.171578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.172158 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.172710 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.172993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.173167 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.186818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:46.193459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:46.195407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 99/197] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:46.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.309210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 99/198] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:43:46.310072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.323604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.346894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3242-af67-4e05-b1ef-875dd4d421e1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.382006 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.382631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.382910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.383181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.383835 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.385323 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.408223 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 100/199] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:46 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:46.408223 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.446606 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.453576 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818932c6-b4d2-41c3-81c6-915fbead1103 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.494286 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.494913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.495198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.495472 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.496193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:46.496493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.497922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.507340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 100/200] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:46.516789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.580616 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cf88c-8866-4077-8826-9963f3c94405 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.628887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.637626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.638928 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.640434 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.644353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.645243 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.647615 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 101/201] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:46.657550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.673464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8290-0bb4-40e7-b37e-227a98e5210d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.729129 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.730066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.730537 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.731019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] PATH_INFO: `/v3/users/45600ed6c9584342869e109a3c14ec24` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.750580 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] RBAC: Authorizing `identity:get_user(user_id=45600ed6c9584342869e109a3c14ec24)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.753186 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 101/202] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/users/45600ed6c9584342869e109a3c14ec24 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:46.762023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.800842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.833250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e406698-9aad-41d1-8324-e33ff62b24ac None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.890103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.890734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.891021 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.891324 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] RBAC: Adding query filter params (role.id=3dbfca88f6e14b6dbd68ed1234f982bd, scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc, user.id=1bd034fe27c844d7bcb0d3b823f939ff) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:46.892491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.893973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.902313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 102/203] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/role_assignments?user.id=1bd034fe27c844d7bcb0d3b823f939ff&scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc&role.id=3dbfca88f6e14b6dbd68ed1234f982bd => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:46.924243 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a20c95-aecc-4c3c-bba9-5a1373961710 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.988181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:47.001034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843024d-7b33-4f16-b9c7-efe7da184b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:47.002639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843024d-7b33-4f16-b9c7-efe7da184b67 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.003457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843024d-7b33-4f16-b9c7-efe7da184b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.004245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843024d-7b33-4f16-b9c7-efe7da184b67 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.006836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843024d-7b33-4f16-b9c7-efe7da184b67 None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:47.010042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843024d-7b33-4f16-b9c7-efe7da184b67 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:47.013760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 102/204] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:47.024248 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:47.212269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5485f0-44ca-467e-82d0-2e2e0fc3d2fc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:47.256240 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2cf94-760e-46d3-aace-4cd8874b7df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:47.257530 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2cf94-760e-46d3-aace-4cd8874b7df8 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.260565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2cf94-760e-46d3-aace-4cd8874b7df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.260565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2cf94-760e-46d3-aace-4cd8874b7df8 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/45600ed6c9584342869e109a3c14ec24/roles/421d8debd72541ae9e2cca388d31be34` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.264014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2cf94-760e-46d3-aace-4cd8874b7df8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8825efeeed9049cfa4f7e8fe43a3bddc, user_id=45600ed6c9584342869e109a3c14ec24, role_id=421d8debd72541ae9e2cca388d31be34)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:47.267593 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2cf94-760e-46d3-aace-4cd8874b7df8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:47.293811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 103/205] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:47 2022] PUT /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/users/45600ed6c9584342869e109a3c14ec24/roles/421d8debd72541ae9e2cca388d31be34 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:48.900478 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e33b8-8a9f-4141-8cd4-c73917eddb3e None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.901181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e33b8-8a9f-4141-8cd4-c73917eddb3e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.901181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e33b8-8a9f-4141-8cd4-c73917eddb3e None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.902605 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 103/206] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:48.908143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad001-f6b3-43b5-87ce-d406908c32cb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.908922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad001-f6b3-43b5-87ce-d406908c32cb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.908922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad001-f6b3-43b5-87ce-d406908c32cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.935821 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d40ad001-f6b3-43b5-87ce-d406908c32cb None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:48.938967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d40ad001-f6b3-43b5-87ce-d406908c32cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:48.944467 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:48.972492 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b496b-b284-43c5-9263-4e1afb8b41ce None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.972890 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b496b-b284-43c5-9263-4e1afb8b41ce None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.973073 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b496b-b284-43c5-9263-4e1afb8b41ce None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.974405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 104/207] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:48.979887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2addf6-0937-40c3-866d-1f898a085539 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.980221 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2addf6-0937-40c3-866d-1f898a085539 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.980541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2addf6-0937-40c3-866d-1f898a085539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.001557 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-eb2addf6-0937-40c3-866d-1f898a085539 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:49.002763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-eb2addf6-0937-40c3-866d-1f898a085539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:49.059634 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 104/208] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:49.090951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 105/209] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:49.338592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad001-f6b3-43b5-87ce-d406908c32cb None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:49.363776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2addf6-0937-40c3-866d-1f898a085539 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:49.467669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad001-f6b3-43b5-87ce-d406908c32cb None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:49.504038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:49.504631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.504907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.505179 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.506290 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2addf6-0937-40c3-866d-1f898a085539 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:49.506426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:49.507785 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:49.509644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 105/210] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:49.515338 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:49.528367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:49.544932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:49.555258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:49.555889 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.556163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.556471 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.568177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:49.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:49.574794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:49.576392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 106/211] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:49.585695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:49.684461 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00a86-1c70-404e-ba93-8f12bd72bd36 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:49.700766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc2e6e-f889-4643-8785-ef7654209a49 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:49.737079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:49.737697 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.737982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.738254 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.738998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:49.739301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:49.740993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:49.747613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0f403-3b00-4523-9c55-7523db4a566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:49.748719 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f403-3b00-4523-9c55-7523db4a566a None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.749311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f403-3b00-4523-9c55-7523db4a566a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.749886 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f403-3b00-4523-9c55-7523db4a566a None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.750347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 107/212] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:49.751570 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0f403-3b00-4523-9c55-7523db4a566a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:49.754427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0f403-3b00-4523-9c55-7523db4a566a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:49.756269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:49.786814 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 106/213] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:49 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:43:49.788077 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3f0e-3b02-43b3-9e55-a9e729e28ba1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.788463 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3f0e-3b02-43b3-9e55-a9e729e28ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.788741 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3f0e-3b02-43b3-9e55-a9e729e28ba1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.789969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 107/214] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:49.798511 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeafd1-7de0-4b44-9527-81fa1a280dd9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.798768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeafd1-7de0-4b44-9527-81fa1a280dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.799181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeafd1-7de0-4b44-9527-81fa1a280dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.821659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-36eeafd1-7de0-4b44-9527-81fa1a280dd9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:49.822985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-36eeafd1-7de0-4b44-9527-81fa1a280dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:49.831118 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:49.896876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:49.897134 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bd1de-8fc3-4542-a4f3-862ae7b91ff5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:49.910171 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 108/215] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:49.941355 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:49.942092 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.942441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.942743 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] PATH_INFO: `/v3/users/9756f59f27524c779c023d743fce3851` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.961216 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] RBAC: Authorizing `identity:get_user(user_id=9756f59f27524c779c023d743fce3851)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:49.963152 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:49.968985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 108/216] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:49 2022] GET /identity/v3/users/9756f59f27524c779c023d743fce3851 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:49.972691 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeafd1-7de0-4b44-9527-81fa1a280dd9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.121960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeafd1-7de0-4b44-9527-81fa1a280dd9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.172418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.173670 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.174076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.174484 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.175644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] RBAC: Adding query filter params (role.id=3dbfca88f6e14b6dbd68ed1234f982bd, user.id=9756f59f27524c779c023d743fce3851, scope.system=all) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:50.176176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:50.179618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:50.180838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.189819 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 109/217] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 16 00:43:49 2022] GET /identity/v3/role_assignments?user.id=9756f59f27524c779c023d743fce3851&scope.system=all&role.id=3dbfca88f6e14b6dbd68ed1234f982bd => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:50.366087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d846-5092-4b39-8e80-8527ad6576c7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.384555 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:50.429578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.430575 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.431044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.431507 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.450407 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:50.460736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:50.462439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:50.463434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 109/218] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:50.473501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.581149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:50.656565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f4712-becc-42d9-a49c-e76153ffcba7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.714464 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.715438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.715908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.716405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.718117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:50.718656 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:50.721243 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:50.737289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 110/219] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:50.746217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.933336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273eb2-6c16-4836-9b3f-f6f402a01860 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.997255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.000028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.000816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.001563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] PATH_INFO: `/v3/users/45600ed6c9584342869e109a3c14ec24` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.003860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] RBAC: Authorizing `identity:get_user(user_id=45600ed6c9584342869e109a3c14ec24)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.006834 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.010200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 110/220] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/users/45600ed6c9584342869e109a3c14ec24 => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:51.019601 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.140058 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b66ff2-b75e-48d7-9dc8-536d02edd6de None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.161919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.178796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.179827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.180333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.180823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.269770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.271655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.418401 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 111/221] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:51.419511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.466637 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.582315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067627f-7f08-41da-a173-cb6ba18ba2af None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.627982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f57ecb-2689-44a1-ba74-18119f7ca3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.629068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57ecb-2689-44a1-ba74-18119f7ca3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.629557 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57ecb-2689-44a1-ba74-18119f7ca3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.630041 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57ecb-2689-44a1-ba74-18119f7ca3a6 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.631535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f57ecb-2689-44a1-ba74-18119f7ca3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.633333 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f57ecb-2689-44a1-ba74-18119f7ca3a6 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.635437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 111/222] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:51.645013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.684844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.830293 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12660a-7976-4ed2-8faf-4ec619107a60 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.891108 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a19b9-895e-4652-b055-1f043b6446f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.892052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a19b9-895e-4652-b055-1f043b6446f6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.892559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a19b9-895e-4652-b055-1f043b6446f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.892851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a19b9-895e-4652-b055-1f043b6446f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.894452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a19b9-895e-4652-b055-1f043b6446f6 None admin] RBAC: Adding query filter params (role.id=421d8debd72541ae9e2cca388d31be34, scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc, user.id=45600ed6c9584342869e109a3c14ec24) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:51.894991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a19b9-895e-4652-b055-1f043b6446f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.897637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a19b9-895e-4652-b055-1f043b6446f6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.907261 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 112/223] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/role_assignments?user.id=45600ed6c9584342869e109a3c14ec24&scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc&role.id=421d8debd72541ae9e2cca388d31be34 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:52.336915 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043e37b-cbff-4fe8-814e-88e9d5613d5c None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.337470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043e37b-cbff-4fe8-814e-88e9d5613d5c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.337878 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043e37b-cbff-4fe8-814e-88e9d5613d5c None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.340648 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 112/224] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:52.350142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270a7d-2ac8-41e3-9552-65bca171d70e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.350688 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270a7d-2ac8-41e3-9552-65bca171d70e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.351124 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270a7d-2ac8-41e3-9552-65bca171d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.383543 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-8f270a7d-2ac8-41e3-9552-65bca171d70e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:52.385658 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8f270a7d-2ac8-41e3-9552-65bca171d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:52.507357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 113/225] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:52.637930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f60e8-6f45-4eaa-af9a-980a40335dfe None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.638430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f60e8-6f45-4eaa-af9a-980a40335dfe None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.638880 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f60e8-6f45-4eaa-af9a-980a40335dfe None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 113/226] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:52.650960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9e4ac-67f1-4cef-9174-a0a76d28fb1f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.651579 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9e4ac-67f1-4cef-9174-a0a76d28fb1f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.652089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9e4ac-67f1-4cef-9174-a0a76d28fb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.683805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-53f9e4ac-67f1-4cef-9174-a0a76d28fb1f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:52.685561 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-53f9e4ac-67f1-4cef-9174-a0a76d28fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:52.707035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.820940 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 114/227] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:52.821190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd64a4-9427-4cb2-829c-d46e27886e09 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.821533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd64a4-9427-4cb2-829c-d46e27886e09 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.821967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd64a4-9427-4cb2-829c-d46e27886e09 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.824752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 114/228] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:52.831001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce64c4-462f-450a-8212-af4134db1cbc None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.831326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce64c4-462f-450a-8212-af4134db1cbc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.831628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce64c4-462f-450a-8212-af4134db1cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.853049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bdce64c4-462f-450a-8212-af4134db1cbc None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:52.854315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bdce64c4-462f-450a-8212-af4134db1cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:52.872538 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd64a4-9427-4cb2-829c-d46e27886e09 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.945116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 115/229] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:53.045820 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd64a4-9427-4cb2-829c-d46e27886e09 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.051596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.113334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.114294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.114754 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.115215 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.134695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:53.144972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:53.145906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:53.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:53.147838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 115/230] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:53.153158 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce64c4-462f-450a-8212-af4134db1cbc None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.250999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.282503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce64c4-462f-450a-8212-af4134db1cbc None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.313024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.327925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.328918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.329339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.329795 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.330823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.331334 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.333801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.346950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 116/231] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:53.348134 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.461980 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f95e4-af9e-4142-b579-8624fbbd3594 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.484794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5f3a-e7ae-44a2-828a-f2725e9eb539 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.513061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.513710 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.513984 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.514887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.526617 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:53.527061 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.527795 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.528157 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.528567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.530500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.532049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:53.532591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:53.534524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:53.536125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:53.536962 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 117/232] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.536962 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.537294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 116/233] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:53.540300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.583839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.655452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faea10-fbd5-4cf3-9a5c-6ae784fed071 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.675794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8cc9-350f-493f-867f-2688542479ef None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.697032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.698013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.698473 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.698920 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] PATH_INFO: `/v3/users/38df729abe2b41d2a617a7569aec1c44` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.721807 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] RBAC: Authorizing `identity:get_user(user_id=38df729abe2b41d2a617a7569aec1c44)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.723069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.723488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.723807 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.724146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.724526 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.725271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.725648 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.725822 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 118/234] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/users/38df729abe2b41d2a617a7569aec1c44 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.727002 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.727550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.740436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 117/235] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:53.740688 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.804655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.856558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07e529-4b64-4722-81c9-d0e0299851d0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.857934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.877552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e3be5-3413-45b2-9566-e3bb73663d43 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.906054 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.907075 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.907576 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.908065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] PATH_INFO: `/v3/groups` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.909263 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.911982 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.915017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.915638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.915920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.916199 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.917250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] RBAC: Adding query filter params (role.id=421d8debd72541ae9e2cca388d31be34, user.id=38df729abe2b41d2a617a7569aec1c44, scope.system=all) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.917567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.919021 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.925244 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 118/236] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/role_assignments?user.id=38df729abe2b41d2a617a7569aec1c44&scope.system=all&role.id=421d8debd72541ae9e2cca388d31be34 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.926095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.952354 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 119/237] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Oct 16 00:43:53 2022] POST /identity/v3/groups => generated 229 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:54.100702 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e880-7717-4cdb-a46f-96be6cbfe45f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:54.145613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83fd5c-f790-4cfc-be88-4aed7d495da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:54.146273 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fd5c-f790-4cfc-be88-4aed7d495da4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:54.146554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fd5c-f790-4cfc-be88-4aed7d495da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:54.146826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fd5c-f790-4cfc-be88-4aed7d495da4 None admin] PATH_INFO: `/v3/users/9756f59f27524c779c023d743fce3851` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:54.148201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83fd5c-f790-4cfc-be88-4aed7d495da4 None admin] RBAC: Authorizing `identity:get_user(user_id=9756f59f27524c779c023d743fce3851)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:54.149789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83fd5c-f790-4cfc-be88-4aed7d495da4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:54.151910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 119/238] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/users/9756f59f27524c779c023d743fce3851 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:54.158737 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:54.294261 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3875c-62a8-4e4f-9897-3e54d4524163 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:54.318618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:54.335317 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1722-2729-42d8-8366-a615fa5acbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:54.335994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1722-2729-42d8-8366-a615fa5acbd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:54.336275 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1722-2729-42d8-8366-a615fa5acbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:54.336582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1722-2729-42d8-8366-a615fa5acbd3 None admin] PATH_INFO: `/v3/system/users/9756f59f27524c779c023d743fce3851/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:54.338047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe1722-2729-42d8-8366-a615fa5acbd3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9756f59f27524c779c023d743fce3851, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:54.339438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe1722-2729-42d8-8366-a615fa5acbd3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:54.350825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 120/239] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Oct 16 00:43:54 2022] PUT /identity/v3/system/users/9756f59f27524c779c023d743fce3851/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:56.588985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788e62-84cb-461b-85b9-a92b0039ea4c None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.589527 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788e62-84cb-461b-85b9-a92b0039ea4c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.589952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788e62-84cb-461b-85b9-a92b0039ea4c None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.593073 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 120/240] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:56.599285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3e270-022b-4e4f-a84a-2ed397b64276 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.600067 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3e270-022b-4e4f-a84a-2ed397b64276 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.600198 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3e270-022b-4e4f-a84a-2ed397b64276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a7b3e270-022b-4e4f-a84a-2ed397b64276 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:56.628044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a7b3e270-022b-4e4f-a84a-2ed397b64276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:56.712088 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 121/241] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:56.997525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a788e62-84cb-461b-85b9-a92b0039ea4c None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.018805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a626b-118b-4a55-8405-0ad9203c1b85 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.019233 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a626b-118b-4a55-8405-0ad9203c1b85 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.019384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a626b-118b-4a55-8405-0ad9203c1b85 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.021184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 122/242] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:57.027966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b644b6-06bc-4a27-b21a-17013edcdddc None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.028519 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b644b6-06bc-4a27-b21a-17013edcdddc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.028993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b644b6-06bc-4a27-b21a-17013edcdddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.054345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-85b644b6-06bc-4a27-b21a-17013edcdddc None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:57.056223 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-85b644b6-06bc-4a27-b21a-17013edcdddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:57.175738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 123/243] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:57.186035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a788e62-84cb-461b-85b9-a92b0039ea4c None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.236403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1385372-7c74-4c23-ae6b-3872d9a5a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.237245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1385372-7c74-4c23-ae6b-3872d9a5a547 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.237657 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1385372-7c74-4c23-ae6b-3872d9a5a547 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.238062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1385372-7c74-4c23-ae6b-3872d9a5a547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.251341 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1385372-7c74-4c23-ae6b-3872d9a5a547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-d1385372-7c74-4c23-ae6b-3872d9a5a547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:57.257285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:57.258996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:57.261301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:43:57.264991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 121/244] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:57.268008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b644b6-06bc-4a27-b21a-17013edcdddc None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.333644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.438777 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b644b6-06bc-4a27-b21a-17013edcdddc None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.507078 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.508122 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.508644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.509132 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.510384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:57.510927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.513593 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.518776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870630-f421-4255-8c0e-6782f3752283 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.519201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870630-f421-4255-8c0e-6782f3752283 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.519651 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870630-f421-4255-8c0e-6782f3752283 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.522212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 122/245] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:57.530595 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96960421-e239-4d7e-9914-99910c2988f9 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.531241 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96960421-e239-4d7e-9914-99910c2988f9 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.533309 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96960421-e239-4d7e-9914-99910c2988f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.536411 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 124/246] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:57.541024 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.566837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-96960421-e239-4d7e-9914-99910c2988f9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:57.568730 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-96960421-e239-4d7e-9914-99910c2988f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:57.668369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 123/247] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:57.683297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96960421-e239-4d7e-9914-99910c2988f9 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.695582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.727271 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df7f0-c7a0-4d2c-9ab1-c58428fa10f9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.739897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.773523 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.774100 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.774343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.774708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] PATH_INFO: `/v3/users/9756f59f27524c779c023d743fce3851` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.775921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] RBAC: Authorizing `identity:get_user(user_id=9756f59f27524c779c023d743fce3851)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.777635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.779716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 125/248] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/users/9756f59f27524c779c023d743fce3851 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:57.785561 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.842650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96960421-e239-4d7e-9914-99910c2988f9 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.910333 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.912182 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.912873 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.913548 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.914827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1996a-7980-4fae-8c4e-aabb384c4303 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.915926 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.919296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.923075 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 124/249] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:57.929963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.964764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.965492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.965833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.966981 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] RBAC: Adding query filter params (role.id=3dbfca88f6e14b6dbd68ed1234f982bd, user.id=9756f59f27524c779c023d743fce3851, scope.system=all) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:57.967478 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.969264 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.983317 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 126/250] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/role_assignments?user.id=9756f59f27524c779c023d743fce3851&scope.system=all&role.id=3dbfca88f6e14b6dbd68ed1234f982bd => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:57.984193 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.028020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.071255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.104799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a70cb-eb30-4d38-a539-f0fcecbfb797 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.162298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.163352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.163838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.164367 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] PATH_INFO: `/v3/groups` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.165570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.166321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8bc75-ab03-4575-a555-a1f811ed73e9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.168484 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.199071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 125/251] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Oct 16 00:43:57 2022] POST /identity/v3/groups => generated 226 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:58.227568 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.228184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.228734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.229221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.255202 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:58.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:58.268001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:43:58.269468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 127/252] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:58.279019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.460240 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90328ac-9255-4084-8bc7-209bd63f56c2 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.524535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.525623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.526111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.526590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.527806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:58.528368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.531272 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.535417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.550558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 126/253] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:58.557464 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.729029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.739946 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08df8-1304-4fe3-af66-062e5ecf59ca None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.814950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1375a-ada2-4ec7-967d-052dde21d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.816086 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1375a-ada2-4ec7-967d-052dde21d422 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.816619 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1375a-ada2-4ec7-967d-052dde21d422 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.817168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1375a-ada2-4ec7-967d-052dde21d422 None admin] PATH_INFO: `/v3/users/38df729abe2b41d2a617a7569aec1c44` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.819261 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1375a-ada2-4ec7-967d-052dde21d422 None admin] RBAC: Authorizing `identity:get_user(user_id=38df729abe2b41d2a617a7569aec1c44)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.822060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1375a-ada2-4ec7-967d-052dde21d422 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.825093 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 128/254] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/users/38df729abe2b41d2a617a7569aec1c44 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:58.834744 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:59.037265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0737dc-4f91-4e5d-a199-c91338ddd8ff None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:59.105665 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a5cdf-2938-429c-bfb6-0f0e15bd4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:59.106684 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5cdf-2938-429c-bfb6-0f0e15bd4176 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.107172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5cdf-2938-429c-bfb6-0f0e15bd4176 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.107658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5cdf-2938-429c-bfb6-0f0e15bd4176 None admin] PATH_INFO: `/v3/system/users/38df729abe2b41d2a617a7569aec1c44/roles/421d8debd72541ae9e2cca388d31be34` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.113862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a5cdf-2938-429c-bfb6-0f0e15bd4176 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=38df729abe2b41d2a617a7569aec1c44, role_id=421d8debd72541ae9e2cca388d31be34)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:59.116579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a5cdf-2938-429c-bfb6-0f0e15bd4176 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:59.135382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 127/255] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Oct 16 00:43:58 2022] PUT /identity/v3/system/users/38df729abe2b41d2a617a7569aec1c44/roles/421d8debd72541ae9e2cca388d31be34 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:02.734387 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0c472-1384-4ff7-873d-896a4a412b80 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.735210 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0c472-1384-4ff7-873d-896a4a412b80 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.735210 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0c472-1384-4ff7-873d-896a4a412b80 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.736867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 129/256] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:02.745585 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8298466-3632-40bc-aa17-342122d34f0b None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.746428 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8298466-3632-40bc-aa17-342122d34f0b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.746428 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8298466-3632-40bc-aa17-342122d34f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.778306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-c8298466-3632-40bc-aa17-342122d34f0b None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:02.780157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c8298466-3632-40bc-aa17-342122d34f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:02.877674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 128/257] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 16 00:44:02.954063 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca01d-4af8-48fd-82b5-db4e458d0f34 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.954338 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca01d-4af8-48fd-82b5-db4e458d0f34 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.954678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca01d-4af8-48fd-82b5-db4e458d0f34 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 130/258] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:02.971366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd148a-e154-41f3-bb98-9cac986d1677 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.971659 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd148a-e154-41f3-bb98-9cac986d1677 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.971983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd148a-e154-41f3-bb98-9cac986d1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.993517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-69bd148a-e154-41f3-bb98-9cac986d1677 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:02.994639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-69bd148a-e154-41f3-bb98-9cac986d1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:03.006805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 129/259] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:44:03.463593 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa47a-b647-49d8-8927-fbb95d9caf3d None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.463881 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa47a-b647-49d8-8927-fbb95d9caf3d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.464165 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa47a-b647-49d8-8927-fbb95d9caf3d None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.465567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 131/260] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:03.474095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d39c1-379d-4987-b54e-bf271c6c431d None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.474385 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d39c1-379d-4987-b54e-bf271c6c431d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.474669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d39c1-379d-4987-b54e-bf271c6c431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.482432 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.499067 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-cc1d39c1-379d-4987-b54e-bf271c6c431d None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:03.500624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-cc1d39c1-379d-4987-b54e-bf271c6c431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:03.510710 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 130/261] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:44:03.554635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66004e-ec89-4ffa-9a25-2bda9ca1754b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.554919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66004e-ec89-4ffa-9a25-2bda9ca1754b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.555245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66004e-ec89-4ffa-9a25-2bda9ca1754b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.556600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 132/262] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:03.567688 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925481bd-c656-4d2d-b121-97de87b00145 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.567966 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925481bd-c656-4d2d-b121-97de87b00145 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.569378 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925481bd-c656-4d2d-b121-97de87b00145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.595042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-925481bd-c656-4d2d-b121-97de87b00145 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:03.598751 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-925481bd-c656-4d2d-b121-97de87b00145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:03.611246 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 131/263] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:44:03.647552 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66004e-ec89-4ffa-9a25-2bda9ca1754b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.664045 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66004e-ec89-4ffa-9a25-2bda9ca1754b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.674453 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.675118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.675391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.675667 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.690901 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:03.695828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:03.697538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:03.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 133/264] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:03.704371 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925481bd-c656-4d2d-b121-97de87b00145 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.726592 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925481bd-c656-4d2d-b121-97de87b00145 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.742161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.743166 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.743648 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.744136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.745410 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.745954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.749187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING py.warnings [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:44:03.749187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: warnings.warn(msg) Oct 16 00:44:03.749187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: Oct 16 00:44:03.750869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.772376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 132/265] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.777808 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.794783 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668e5b0-198d-42d6-b103-46b199ea09a2 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.810008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.810690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.810960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.811233 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.821403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.823207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:44:03.823207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:44:03.823207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:44:03.824498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.826202 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 134/266] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.833591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.857106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762a429-683f-4ab8-938d-034c1f3c4b45 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.862403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.873498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.874569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.875021 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.875506 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd744c37-6041-4345-ae62-12ccc4fda35a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.875760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.877497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.881544 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.884853 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 133/267] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.886431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.887092 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.887354 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.887631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.892065 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.921625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:03.922071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe946e-aec1-4f23-a7b2-1f699247caa8 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:03.926654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:03.930052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:03.933231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 135/268] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:03.940416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.940416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.940416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.940416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21/groups/d7c945c68df6421c81bc83b502ec0cec/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.945728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6e200cbb14521a279711e4a298e21, group_id=d7c945c68df6421c81bc83b502ec0cec, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.947448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.947711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING py.warnings [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:44:03.947711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: warnings.warn(msg) Oct 16 00:44:03.947711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: Oct 16 00:44:03.952297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.965159 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2719c0d-2317-420b-adeb-d441f92c6a42 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.976575 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.977515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.977890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.978148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.978877 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.979304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.980666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:44:03.980666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:44:03.980666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:44:03.981710 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.992141 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 134/269] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 16 00:44:03 2022] PUT /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21/groups/d7c945c68df6421c81bc83b502ec0cec/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:44:04.006587 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 136/270] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:04.017404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.087478 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.114921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa4a7c-4b88-4984-806f-41f03943b442 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.132334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff628-c5ae-450b-b621-9ac0ff5709bd admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.143225 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.143915 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.144184 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.144493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.146033 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.147098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING py.warnings [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:44:04.147098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: warnings.warn(msg) Oct 16 00:44:04.147098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: Oct 16 00:44:04.150040 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.152356 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 135/271] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.163315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.187917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662cb6a-6207-491d-b589-30d564750766 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.212809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.213848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.214311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.214695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.218126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.233924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.238239 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 136/272] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.240851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.274965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.276050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.276621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.277125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.284348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17924b-53d1-4384-ba54-1afd1d4f085c admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.294430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d64f13-6ead-49a7-8ffe-40b2f407e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.295190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64f13-6ead-49a7-8ffe-40b2f407e4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.295617 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64f13-6ead-49a7-8ffe-40b2f407e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.296077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64f13-6ead-49a7-8ffe-40b2f407e4d5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.301037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:04.307285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:04.308294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:04.309139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:04.311368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 137/273] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:04.312107 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.322161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d64f13-6ead-49a7-8ffe-40b2f407e4d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-22d64f13-6ead-49a7-8ffe-40b2f407e4d5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:04.327804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:04.328841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:04.329650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 137/274] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:04.331144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b12b3-1991-454c-9738-76c34598433a None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.331433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b12b3-1991-454c-9738-76c34598433a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.331708 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b12b3-1991-454c-9738-76c34598433a None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.336436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 138/275] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:04.336436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b12b3-1991-454c-9738-76c34598433a None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.338880 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cc3d2-cea1-46a4-b915-fce9ef938f6d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.346043 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a70a5-7a19-4c78-a342-8072442bd974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.347178 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a70a5-7a19-4c78-a342-8072442bd974 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.347796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a70a5-7a19-4c78-a342-8072442bd974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.348350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a70a5-7a19-4c78-a342-8072442bd974 admin admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/groups/d7c945c68df6421c81bc83b502ec0cec/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.353336 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a70a5-7a19-4c78-a342-8072442bd974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8825efeeed9049cfa4f7e8fe43a3bddc, group_id=d7c945c68df6421c81bc83b502ec0cec, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.354836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-7c6a70a5-7a19-4c78-a342-8072442bd974 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:44:04.354836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:44:04.354836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:44:04.357757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a70a5-7a19-4c78-a342-8072442bd974 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.359798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b12b3-1991-454c-9738-76c34598433a None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.366335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.367621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.368347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.368909 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.370447 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:04.371126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.374986 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.378948 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 138/276] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 16 00:44:04 2022] PUT /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/groups/d7c945c68df6421c81bc83b502ec0cec/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:04.381446 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798bdd-b7c6-4445-b460-02a96aa37807 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.386403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798bdd-b7c6-4445-b460-02a96aa37807 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.388055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798bdd-b7c6-4445-b460-02a96aa37807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.394054 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 139/277] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.398447 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.414451 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-11798bdd-b7c6-4445-b460-02a96aa37807 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:04.416097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-11798bdd-b7c6-4445-b460-02a96aa37807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:04.416525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5e0a-2f07-4b0c-af06-6d712b417c8c admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.499819 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:04.534395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 139/278] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:04.535337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798bdd-b7c6-4445-b460-02a96aa37807 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.538568 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.539579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.540101 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.540703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.541818 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:04.542462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.545989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.558164 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798bdd-b7c6-4445-b460-02a96aa37807 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.563869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 140/279] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.570252 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.570926 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.571278 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.571566 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.573352 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.574875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.575484 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.578589 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 140/280] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.584125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.597341 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ab4fe-abf2-41e8-a62f-eb566a58d9d2 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.602861 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471020b-670e-4cce-a0e8-ae4724568f5f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.617524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483c59d-56dd-4ca8-8bbf-2e25711bd18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.620438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.621433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483c59d-56dd-4ca8-8bbf-2e25711bd18b admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.622172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483c59d-56dd-4ca8-8bbf-2e25711bd18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.622950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483c59d-56dd-4ca8-8bbf-2e25711bd18b admin admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.623925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.625932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.627849 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483c59d-56dd-4ca8-8bbf-2e25711bd18b admin admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.630227 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.639778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.640640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483c59d-56dd-4ca8-8bbf-2e25711bd18b admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.650869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 141/281] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.652777 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 141/282] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.653105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63040-506a-4e68-9c10-4734e96196cf None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.653807 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63040-506a-4e68-9c10-4734e96196cf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.654368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63040-506a-4e68-9c10-4734e96196cf None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.656695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 142/283] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:04.657363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.658463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63040-506a-4e68-9c10-4734e96196cf None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.676046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9963-adbe-4703-b98c-aa8dc78a73c2 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.678803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63040-506a-4e68-9c10-4734e96196cf None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.684507 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.685287 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.685826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.686347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/groups/d7c945c68df6421c81bc83b502ec0cec/roles/f2f3c5ec3295469bbeae5d990f1a59ae` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.688573 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8825efeeed9049cfa4f7e8fe43a3bddc, group_id=d7c945c68df6421c81bc83b502ec0cec, role_id=f2f3c5ec3295469bbeae5d990f1a59ae)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.691268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.694424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560e6d-699a-4798-9ab4-756ab7eaeea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.695531 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560e6d-699a-4798-9ab4-756ab7eaeea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.695825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560e6d-699a-4798-9ab4-756ab7eaeea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.696109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560e6d-699a-4798-9ab4-756ab7eaeea0 admin admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.698049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560e6d-699a-4798-9ab4-756ab7eaeea0 admin admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.700257 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560e6d-699a-4798-9ab4-756ab7eaeea0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.703640 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 142/284] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:04.709003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ccdd-84ee-4765-9668-ddb69a535770 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.709541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ccdd-84ee-4765-9668-ddb69a535770 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.709824 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ccdd-84ee-4765-9668-ddb69a535770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.712752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 143/285] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 16 00:44:04 2022] PUT /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc/groups/d7c945c68df6421c81bc83b502ec0cec/roles/f2f3c5ec3295469bbeae5d990f1a59ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:04.713908 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.738376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:04.761635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4646ccdd-84ee-4765-9668-ddb69a535770 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:04.762757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4646ccdd-84ee-4765-9668-ddb69a535770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:04.838277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b0c22-2815-45f2-895b-15addfe393f8 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.845211 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.846076 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.846512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.846896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21/groups/d7c945c68df6421c81bc83b502ec0cec/roles/f2f3c5ec3295469bbeae5d990f1a59ae` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.850269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6e200cbb14521a279711e4a298e21, group_id=d7c945c68df6421c81bc83b502ec0cec, role_id=f2f3c5ec3295469bbeae5d990f1a59ae)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.853406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.881011 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 144/286] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 16 00:44:04 2022] PUT /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21/groups/d7c945c68df6421c81bc83b502ec0cec/roles/f2f3c5ec3295469bbeae5d990f1a59ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:04.895332 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 143/287] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:44:05.105673 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.240411 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bb9ad-ca2d-4e6e-8cd7-024aa6da17db admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.279662 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.280586 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.280919 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.281322 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.295710 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:05.301674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:05.302829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:44:05.303822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:05.305896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 145/288] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:05.311908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646ccdd-84ee-4765-9668-ddb69a535770 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.321512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.353960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:05.443646 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646ccdd-84ee-4765-9668-ddb69a535770 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.461612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:05.473471 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71a5bf-4ae7-47f7-8545-fe18b763c98f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.491508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.492560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.493167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.493655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.494542 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:05.495104 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.496723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.508358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.508358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.508358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.508358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.512450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 144/289] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:05.519391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.529023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:05.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:05.535680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:05.543489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 146/290] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:05.545497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.564419 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c9206-fcf7-4ce9-94cd-27dd6c936e19 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.589700 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.590335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.590628 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.590888 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.591596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:05.592441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.594375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.622328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 147/291] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:05.630613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.646596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16afd0-ecc7-4acf-a809-41e2c8e124ec admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.669769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.670529 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.670808 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.671085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] PATH_INFO: `/v3/groups/57cad36c97634a6ca3b0dea4853e9aaf` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.686460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] RBAC: Authorizing `identity:get_group(group_id=57cad36c97634a6ca3b0dea4853e9aaf)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.688544 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.694894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 148/292] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/groups/57cad36c97634a6ca3b0dea4853e9aaf => generated 229 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:05.697056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b016-d05f-4aae-a169-ce896b9d3b03 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.699552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.726495 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6032a0-cb63-4b64-b766-43b763362949 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.747706 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.749213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.749496 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.749766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] PATH_INFO: `/v3/projects/3c4625f8f78c492a895e7a32f39f3d29` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.752403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] RBAC: Authorizing `identity:get_project(project_id=3c4625f8f78c492a895e7a32f39f3d29)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.754228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.756107 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 149/293] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/projects/3c4625f8f78c492a895e7a32f39f3d29 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:05.768813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.787958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4974-6c23-4b88-ab27-80bd15f9ec4a admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.789980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.790638 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.791024 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.791450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] PATH_INFO: `/v3/users/38df729abe2b41d2a617a7569aec1c44` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.793057 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] RBAC: Authorizing `identity:get_user(user_id=38df729abe2b41d2a617a7569aec1c44)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.795456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.802900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 145/294] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/users/38df729abe2b41d2a617a7569aec1c44 => generated 293 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:05.809444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.812409 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ca476-dd09-4360-b2c3-5c8ab92ae181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.813413 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ca476-dd09-4360-b2c3-5c8ab92ae181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.813703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ca476-dd09-4360-b2c3-5c8ab92ae181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.813983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ca476-dd09-4360-b2c3-5c8ab92ae181 admin admin] PATH_INFO: `/v3/projects/3c4625f8f78c492a895e7a32f39f3d29/groups/57cad36c97634a6ca3b0dea4853e9aaf/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.821946 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ca476-dd09-4360-b2c3-5c8ab92ae181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4625f8f78c492a895e7a32f39f3d29, group_id=57cad36c97634a6ca3b0dea4853e9aaf, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.824914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ca476-dd09-4360-b2c3-5c8ab92ae181 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.849251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 150/295] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 16 00:44:05 2022] PUT /identity/v3/projects/3c4625f8f78c492a895e7a32f39f3d29/groups/57cad36c97634a6ca3b0dea4853e9aaf/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:44:05.919509 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:06.016422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0d46-e7d8-4db2-ac99-f48ab67a8019 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.087545 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3eca6-7254-4974-93a8-b7a548fc0733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.088633 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3eca6-7254-4974-93a8-b7a548fc0733 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.089137 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3eca6-7254-4974-93a8-b7a548fc0733 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.089623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3eca6-7254-4974-93a8-b7a548fc0733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.090872 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3eca6-7254-4974-93a8-b7a548fc0733 None admin] RBAC: Adding query filter params (role.id=421d8debd72541ae9e2cca388d31be34, user.id=38df729abe2b41d2a617a7569aec1c44, scope.system=all) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:06.091406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3eca6-7254-4974-93a8-b7a548fc0733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.094264 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3eca6-7254-4974-93a8-b7a548fc0733 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.121411 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 146/296] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/role_assignments?user.id=38df729abe2b41d2a617a7569aec1c44&scope.system=all&role.id=421d8debd72541ae9e2cca388d31be34 => generated 510 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:07.362251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403981f4-861e-4282-97a1-8691571fb951 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.362773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403981f4-861e-4282-97a1-8691571fb951 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.363218 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403981f4-861e-4282-97a1-8691571fb951 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.365670 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 151/297] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:07.371548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e0822-be14-44d9-8cfe-9f12606a674e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.372062 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e0822-be14-44d9-8cfe-9f12606a674e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.372139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e0822-be14-44d9-8cfe-9f12606a674e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.402233 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3b7e0822-be14-44d9-8cfe-9f12606a674e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:07.403487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3b7e0822-be14-44d9-8cfe-9f12606a674e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:07.498923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 147/298] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:07.945834 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535a9f6-9156-455f-bb18-c05d62eaa762 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.946267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535a9f6-9156-455f-bb18-c05d62eaa762 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.946701 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535a9f6-9156-455f-bb18-c05d62eaa762 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.949150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 152/299] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:07.959842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461771e-53de-4559-9a8c-fea2ae7b77f7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.960273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461771e-53de-4559-9a8c-fea2ae7b77f7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.960725 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461771e-53de-4559-9a8c-fea2ae7b77f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.002265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0461771e-53de-4559-9a8c-fea2ae7b77f7 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:08.004443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0461771e-53de-4559-9a8c-fea2ae7b77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:08.011039 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535a9f6-9156-455f-bb18-c05d62eaa762 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:08.058361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:08.164992 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 148/300] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:08.224693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535a9f6-9156-455f-bb18-c05d62eaa762 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:08.252788 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:08.283616 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:08.284679 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.285326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.285807 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.291654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb588bdd-1158-413f-97f8-438e96267712 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.291945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb588bdd-1158-413f-97f8-438e96267712 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.292212 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb588bdd-1158-413f-97f8-438e96267712 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.293876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 149/301] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:08.314327 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:08.323816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:08.324805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:08.325587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:08.326734 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 153/302] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:08.329930 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921faa7-ebcf-40f9-bf8f-c24a76aacddf None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.330218 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921faa7-ebcf-40f9-bf8f-c24a76aacddf None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.330496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921faa7-ebcf-40f9-bf8f-c24a76aacddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.332886 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:08.373522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6921faa7-ebcf-40f9-bf8f-c24a76aacddf None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:08.375027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6921faa7-ebcf-40f9-bf8f-c24a76aacddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:08.580276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dedd1-1fd6-4cbf-aaf5-9008d42841c7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:08.581888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 150/303] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:08.626079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051efde-5daa-41ca-96cc-a338dd3f0735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:08.626763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051efde-5daa-41ca-96cc-a338dd3f0735 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.627108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051efde-5daa-41ca-96cc-a338dd3f0735 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.627386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051efde-5daa-41ca-96cc-a338dd3f0735 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.628062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051efde-5daa-41ca-96cc-a338dd3f0735 None admin] RBAC: Adding query filter params (name=member) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:08.628397 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051efde-5daa-41ca-96cc-a338dd3f0735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:08.629795 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051efde-5daa-41ca-96cc-a338dd3f0735 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:08.639145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 154/304] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:08.645418 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173465-43e2-4b2a-9ff3-3d257773b411 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.645562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921faa7-ebcf-40f9-bf8f-c24a76aacddf None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:08.646100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173465-43e2-4b2a-9ff3-3d257773b411 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.646582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173465-43e2-4b2a-9ff3-3d257773b411 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.648153 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 155/305] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:08.665947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923b8f-0931-4c9a-8f00-8dd34cf80cb1 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.666570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923b8f-0931-4c9a-8f00-8dd34cf80cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.667077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923b8f-0931-4c9a-8f00-8dd34cf80cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.693729 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-cc923b8f-0931-4c9a-8f00-8dd34cf80cb1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:08.695295 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-cc923b8f-0931-4c9a-8f00-8dd34cf80cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:08.752021 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:08.802448 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 156/306] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:08.808801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923b8f-0931-4c9a-8f00-8dd34cf80cb1 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:08.875122 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:08.911116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921faa7-ebcf-40f9-bf8f-c24a76aacddf None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:08.980970 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:08.981598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.981879 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.982155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.028553 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923b8f-0931-4c9a-8f00-8dd34cf80cb1 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.075433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.075714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.075988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.084934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.086795 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.091916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:09.098924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:09.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:09.100726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 157/307] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:09.101991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.139766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.227897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.246099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eb14b-fa24-4146-a630-ce0fcf4f901c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.246623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 151/308] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:09.247486 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.285716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.286365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.286644 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.286913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.299976 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:09.304994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:09.306071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:09.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 158/309] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:09.308381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.390502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff976-1e57-48ae-9908-451ed11e2521 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.437985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.442757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.443959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.443959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.447028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.447028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:09.447028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.447028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.457766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a9739-0211-43ac-9cf6-a5724afb65af None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.458166 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 152/310] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:09.459028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.503381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.504745 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.505026 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.505298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.528516 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:09.537010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:09.537972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:09.538764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:09.539868 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 159/311] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:09.540747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.571419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.657554 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e87e-2ce5-410f-b181-33e6a3d18c5a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.700032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.700974 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.701796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.702079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.703359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.705339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.706949 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 153/312] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:09.707760 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.716025 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08511740-2eec-4b8b-a585-7e7b709ec9cf None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.758080 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.758790 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.759036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.759289 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.760046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:09.760435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.762430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 160/313] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:09.773814 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.796519 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.858729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d9e65-5289-49d7-99f7-8fe0cbd66258 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.883148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.900090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.901230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.901627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.906061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d28f-875e-4fa4-b162-f442b252d4a5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.942763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b993905-fb9a-4a6d-9d14-7b0bbb12719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.943278 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993905-fb9a-4a6d-9d14-7b0bbb12719e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.943555 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993905-fb9a-4a6d-9d14-7b0bbb12719e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993905-fb9a-4a6d-9d14-7b0bbb12719e None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.944541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993905-fb9a-4a6d-9d14-7b0bbb12719e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:09.944846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993905-fb9a-4a6d-9d14-7b0bbb12719e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.946257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993905-fb9a-4a6d-9d14-7b0bbb12719e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.955757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 161/314] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:09.957129 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f099a5-a70f-47ac-86cb-1b6354d03ef9 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.957422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f099a5-a70f-47ac-86cb-1b6354d03ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.957686 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f099a5-a70f-47ac-86cb-1b6354d03ef9 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.959557 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 162/315] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:09.962312 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f099a5-a70f-47ac-86cb-1b6354d03ef9 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.987112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.988659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.054490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.085086 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f099a5-a70f-47ac-86cb-1b6354d03ef9 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.107716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 154/316] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:10.109483 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.126657 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.127311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.127593 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.127870 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.129145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.130627 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.132303 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 163/317] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:10.133138 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.135573 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.230302 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1480b-3409-41c2-be87-317a849b9db9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.256465 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e65059-9456-4276-8f5b-1e95a07b01ee None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.269053 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8239fd-fe16-4aa5-8adb-862edfff3c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.269670 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8239fd-fe16-4aa5-8adb-862edfff3c6d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.269957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8239fd-fe16-4aa5-8adb-862edfff3c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.270230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8239fd-fe16-4aa5-8adb-862edfff3c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.301179 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.301794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.302067 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.302345 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.316736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.350584 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8239fd-fe16-4aa5-8adb-862edfff3c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.352074 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8239fd-fe16-4aa5-8adb-862edfff3c6d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.377069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.385342 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.386948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.473031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 155/318] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:10.478452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfbfd6-60fa-41ca-b825-a54940db7575 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.478452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfbfd6-60fa-41ca-b825-a54940db7575 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.478452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfbfd6-60fa-41ca-b825-a54940db7575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.497013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6dcfbfd6-60fa-41ca-b825-a54940db7575 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:10.498372 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6dcfbfd6-60fa-41ca-b825-a54940db7575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:10.504207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 164/319] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:10.507096 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.556756 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.572025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 156/320] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:10.572940 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfbfd6-60fa-41ca-b825-a54940db7575 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.641781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98701ec-d1c2-40d8-bce3-3f1651ab0b4b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.650165 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.701684 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.703600 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.703973 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.704468 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.706101 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.707587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.709801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 165/321] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:10.710463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.738354 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfbfd6-60fa-41ca-b825-a54940db7575 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.795079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.796167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.796609 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.797029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.797915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] RBAC: Adding query filter params (group.id=d7c945c68df6421c81bc83b502ec0cec, role.id=3dbfca88f6e14b6dbd68ed1234f982bd, scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:10.798446 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.800364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.816862 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 157/322] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/role_assignments?group.id=d7c945c68df6421c81bc83b502ec0cec&scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc&role.id=3dbfca88f6e14b6dbd68ed1234f982bd => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:10.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.901962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4e8ee-3640-4eb9-8cc8-0462e036d49d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.917315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.948132 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.949353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.949947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.950473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] PATH_INFO: `/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.952250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] RBAC: Authorizing `identity:get_project(project_id=8825efeeed9049cfa4f7e8fe43a3bddc)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.954005 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.961765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 166/323] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/projects/8825efeeed9049cfa4f7e8fe43a3bddc => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:10.962245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.022052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e26c-d665-4e5e-ab01-21607bde1436 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.047117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.077920 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.078600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.078887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.079165 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] PATH_INFO: `/v3/projects/9cb6e200cbb14521a279711e4a298e21` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.080502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] RBAC: Authorizing `identity:get_project(project_id=9cb6e200cbb14521a279711e4a298e21)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.082226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.083929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 158/324] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/projects/9cb6e200cbb14521a279711e4a298e21 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.088033 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.129477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce70460-43f1-461e-ae11-9cfd335ae32f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.178087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.178735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.179019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.179296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.180493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.181963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.183596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 167/325] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.183596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.220011 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd2e5-f329-4432-a803-e8a48e5ff292 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.252121 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.258064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14567858-8257-4c59-aec0-a91be459315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.258786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14567858-8257-4c59-aec0-a91be459315c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.259135 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14567858-8257-4c59-aec0-a91be459315c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.259464 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14567858-8257-4c59-aec0-a91be459315c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.273374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14567858-8257-4c59-aec0-a91be459315c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-14567858-8257-4c59-aec0-a91be459315c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:11.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:11.279966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 159/326] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:11.281018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14567858-8257-4c59-aec0-a91be459315c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.321726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c17c-7111-4640-b4e5-d73a582927fd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.329435 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.359958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.360639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.360931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.361208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.362374 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.363848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.365745 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 168/327] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.366728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.403492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14567858-8257-4c59-aec0-a91be459315c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.440534 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.441184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.441461 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.441734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] PATH_INFO: `/v3/groups/d7c945c68df6421c81bc83b502ec0cec` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.442889 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] RBAC: Authorizing `identity:get_group(group_id=d7c945c68df6421c81bc83b502ec0cec)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.445979 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 160/328] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/groups/d7c945c68df6421c81bc83b502ec0cec => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.446763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.532996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6c3d-42c8-43da-a0c3-e03ca3063669 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.559935 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.595977 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfccaf4-2cef-4ce4-9933-459c0fc1a581 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.596835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.597196 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.597561 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.598023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.598854 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] RBAC: Adding query filter params (group.id=d7c945c68df6421c81bc83b502ec0cec, role.id=3dbfca88f6e14b6dbd68ed1234f982bd, scope.project.id=9cb6e200cbb14521a279711e4a298e21) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:11.599332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.601405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.609442 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 169/329] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/role_assignments?group.id=d7c945c68df6421c81bc83b502ec0cec&scope.project.id=9cb6e200cbb14521a279711e4a298e21&role.id=3dbfca88f6e14b6dbd68ed1234f982bd => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.624767 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.624979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.660733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.661702 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.662157 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.662604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.663715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:11.664210 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.666668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.688160 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 161/330] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.689565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.781987 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b235783-c350-4813-8407-9d15b959f4ff None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.845083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.846085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.847211 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.847211 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.848948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] RBAC: Adding query filter params (group.id=d7c945c68df6421c81bc83b502ec0cec, role.id=f2f3c5ec3295469bbeae5d990f1a59ae, scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:11.849068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.852433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.861544 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 170/331] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/role_assignments?group.id=d7c945c68df6421c81bc83b502ec0cec&scope.project.id=8825efeeed9049cfa4f7e8fe43a3bddc&role.id=f2f3c5ec3295469bbeae5d990f1a59ae => generated 611 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.862706 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e7c0-5c99-4307-9ecf-0c76ac71490b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.944017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.960275 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.961445 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.961990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.962532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.964695 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] RBAC: Adding query filter params (group.id=d7c945c68df6421c81bc83b502ec0cec, role.id=f2f3c5ec3295469bbeae5d990f1a59ae, scope.project.id=9cb6e200cbb14521a279711e4a298e21) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:11.965396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.968213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.980157 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 162/332] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/role_assignments?group.id=d7c945c68df6421c81bc83b502ec0cec&scope.project.id=9cb6e200cbb14521a279711e4a298e21&role.id=f2f3c5ec3295469bbeae5d990f1a59ae => generated 611 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:12.078593 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d22ad-c6ea-45e9-b0d8-f24ee28edfd2 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:12.131273 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:12.131890 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.132195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.132535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.260845 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:12.262385 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:12.329709 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:12.416615 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 171/333] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:12.422927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:12.481456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:12.576562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce936c8-ec04-4a03-832c-c8efb3fef759 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:12.624495 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:12.625591 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.626040 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.626512 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] PATH_INFO: `/v3/projects/3c4625f8f78c492a895e7a32f39f3d29` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.628735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] RBAC: Authorizing `identity:get_project(project_id=3c4625f8f78c492a895e7a32f39f3d29)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:12.631395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:12.634558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 163/334] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:12 2022] GET /identity/v3/projects/3c4625f8f78c492a895e7a32f39f3d29 => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:12.641323 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:12.781839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e263f1-298d-4eb2-ae17-fe4195610649 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:12.824570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99613f-ef72-4a6a-aeee-406d0485f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:12.825218 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99613f-ef72-4a6a-aeee-406d0485f785 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99613f-ef72-4a6a-aeee-406d0485f785 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.825780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99613f-ef72-4a6a-aeee-406d0485f785 None admin] PATH_INFO: `/v3/groups/57cad36c97634a6ca3b0dea4853e9aaf` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.828769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99613f-ef72-4a6a-aeee-406d0485f785 None admin] RBAC: Authorizing `identity:get_group(group_id=57cad36c97634a6ca3b0dea4853e9aaf)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:12.830302 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99613f-ef72-4a6a-aeee-406d0485f785 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:12.832002 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 172/335] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 16 00:44:12 2022] GET /identity/v3/groups/57cad36c97634a6ca3b0dea4853e9aaf => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:12.838325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:12.945957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3168177-572c-4fe9-821f-2546864cf34d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:12.948267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:12.980804 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453270c-c094-4261-b5ef-8c8e8914db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:12.981414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453270c-c094-4261-b5ef-8c8e8914db48 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.981696 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453270c-c094-4261-b5ef-8c8e8914db48 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.981969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453270c-c094-4261-b5ef-8c8e8914db48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.983433 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453270c-c094-4261-b5ef-8c8e8914db48 None admin] RBAC: Adding query filter params (group.id=57cad36c97634a6ca3b0dea4853e9aaf, role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=3c4625f8f78c492a895e7a32f39f3d29) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:12.983738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453270c-c094-4261-b5ef-8c8e8914db48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:12.985208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453270c-c094-4261-b5ef-8c8e8914db48 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:12.991425 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 164/336] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 16 00:44:12 2022] GET /identity/v3/role_assignments?group.id=57cad36c97634a6ca3b0dea4853e9aaf&scope.project.id=3c4625f8f78c492a895e7a32f39f3d29&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:15.659009 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c8f0-43b6-4984-afaa-748a82b8865c None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:15.659814 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c8f0-43b6-4984-afaa-748a82b8865c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:15.659814 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c8f0-43b6-4984-afaa-748a82b8865c None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:15.661205 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 173/337] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:15.682992 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bcb9d-7cba-4a9b-9302-587265f5e8b4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:15.684497 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bcb9d-7cba-4a9b-9302-587265f5e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:15.685258 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bcb9d-7cba-4a9b-9302-587265f5e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:15.726096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f66bcb9d-7cba-4a9b-9302-587265f5e8b4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:15.728816 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f66bcb9d-7cba-4a9b-9302-587265f5e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:15.904436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 165/338] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:15.944663 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58e8a-4893-4e9d-9432-388f9b2b0620 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:15.945963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58e8a-4893-4e9d-9432-388f9b2b0620 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:15.946741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58e8a-4893-4e9d-9432-388f9b2b0620 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:15.948685 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 174/339] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:15.955112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a83f5-ea54-4bc9-a7e4-05e055306f03 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:15.955713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a83f5-ea54-4bc9-a7e4-05e055306f03 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:15.956287 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a83f5-ea54-4bc9-a7e4-05e055306f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:15.985457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-036a83f5-ea54-4bc9-a7e4-05e055306f03 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:15.987052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-036a83f5-ea54-4bc9-a7e4-05e055306f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:16.081606 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 166/340] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:16.281996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a58e8a-4893-4e9d-9432-388f9b2b0620 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.302072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:16.430504 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a58e8a-4893-4e9d-9432-388f9b2b0620 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.476801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.477360 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.477641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.477918 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.493830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.495322 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:16.501666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a83f5-ea54-4bc9-a7e4-05e055306f03 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:16.520207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:16.521284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:16.522144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:16.522144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:16.522144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:16.522144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 175/341] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:16.527697 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.543869 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:16.649097 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:16.695704 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a83f5-ea54-4bc9-a7e4-05e055306f03 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.703656 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f146772-f0ac-4c78-a186-e54373f5c614 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.761859 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.763198 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.764363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.764995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.777432 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.780121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:16.789070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.791354 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.792086 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.792546 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.794332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:16.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:16.801996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:16.803069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:16.803069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:16.803069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:16.803371 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.805112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:16.812527 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 167/342] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:16.821721 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.834776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 176/343] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:16.844720 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.986147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.012913 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364178-fd36-497a-88c4-ee3a22fc9ee9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.044253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaf7d-153d-4129-8f7f-76711f54b0cc None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.067902 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e20f86-e414-4e1f-b149-b6941599fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.068582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20f86-e414-4e1f-b149-b6941599fe48 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.069551 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20f86-e414-4e1f-b149-b6941599fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.069837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e20f86-e414-4e1f-b149-b6941599fe48 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.070870 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e20f86-e414-4e1f-b149-b6941599fe48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:17.071183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e20f86-e414-4e1f-b149-b6941599fe48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:17.072392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.074374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e20f86-e414-4e1f-b149-b6941599fe48 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.086871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07d52c-0143-42a7-9a32-f47d2f01374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.087617 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07d52c-0143-42a7-9a32-f47d2f01374f None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.087972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07d52c-0143-42a7-9a32-f47d2f01374f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.088346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07d52c-0143-42a7-9a32-f47d2f01374f None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.089092 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07d52c-0143-42a7-9a32-f47d2f01374f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:17.090632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 168/344] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:17.090753 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07d52c-0143-42a7-9a32-f47d2f01374f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.092550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710df57-e307-4d2e-999a-a57cef016913 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.092959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710df57-e307-4d2e-999a-a57cef016913 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.093407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710df57-e307-4d2e-999a-a57cef016913 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.095356 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 169/345] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:17.102118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710df57-e307-4d2e-999a-a57cef016913 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.124519 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 177/346] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:16 2022] POST /identity/v3/users => generated 246 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:17.126126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b9627-fe4c-4b9c-9dc6-4ce9e8f2f5d2 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.126532 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b9627-fe4c-4b9c-9dc6-4ce9e8f2f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.126896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b9627-fe4c-4b9c-9dc6-4ce9e8f2f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.148682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-e97b9627-fe4c-4b9c-9dc6-4ce9e8f2f5d2 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:17.150131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e97b9627-fe4c-4b9c-9dc6-4ce9e8f2f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:17.254765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710df57-e307-4d2e-999a-a57cef016913 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.296246 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 178/347] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:17.296505 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f432274-c722-4895-8cf5-644d3b37fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.296505 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432274-c722-4895-8cf5-644d3b37fcae None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.296841 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432274-c722-4895-8cf5-644d3b37fcae None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.297003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432274-c722-4895-8cf5-644d3b37fcae None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.297654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f432274-c722-4895-8cf5-644d3b37fcae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:17.299148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f432274-c722-4895-8cf5-644d3b37fcae None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.301398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c09a-2ea6-46ef-8a41-f361fe0bffe3 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.302124 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c09a-2ea6-46ef-8a41-f361fe0bffe3 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.302607 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c09a-2ea6-46ef-8a41-f361fe0bffe3 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.304371 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 179/348] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:17.310552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7934c-ca92-4b5e-b1fa-1b43ac94ab82 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.311760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7934c-ca92-4b5e-b1fa-1b43ac94ab82 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.312277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7934c-ca92-4b5e-b1fa-1b43ac94ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.312810 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.332112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 170/349] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:17 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:17.345332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-d9d7934c-ca92-4b5e-b1fa-1b43ac94ab82 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:17.347160 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-d9d7934c-ca92-4b5e-b1fa-1b43ac94ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:17.462397 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 180/350] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:17.613701 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490751-698b-40c3-9fb6-a456bb7127f4 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.614488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490751-698b-40c3-9fb6-a456bb7127f4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.614987 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490751-698b-40c3-9fb6-a456bb7127f4 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.617560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 171/351] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:17.626767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d50a-3e90-4793-bbd3-c5f7087c9c44 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.627308 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d50a-3e90-4793-bbd3-c5f7087c9c44 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.627790 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d50a-3e90-4793-bbd3-c5f7087c9c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.652874 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b558d50a-3e90-4793-bbd3-c5f7087c9c44 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:17.655776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b558d50a-3e90-4793-bbd3-c5f7087c9c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:17.665186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490751-698b-40c3-9fb6-a456bb7127f4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.708698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.782224 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 181/352] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:17.783098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d50a-3e90-4793-bbd3-c5f7087c9c44 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.823941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490751-698b-40c3-9fb6-a456bb7127f4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.876914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.876914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.876914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.876914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.900883 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:17.903865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:17.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:17.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:17.938668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:17.938668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:17.938668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:17.938668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 172/353] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:17.946486 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.950750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d50a-3e90-4793-bbd3-c5f7087c9c44 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.033114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.081668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.082304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.082577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.082843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.083538 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.085366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.096797 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c3cd2-54ba-4a60-b45d-c74378e8bfad None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.103018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.sql.core [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:44:18.103018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 16 00:44:18.103018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [parameters: {'id': 'c412ab0e92b348a2be0d0c0699819fe9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 16 00:44:18.103018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:18.120848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return ref.to_dict() Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:18.121781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application yield resource Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise self.value Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application session.commit() Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:44:18.122772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:44:18.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:18.126014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:18.128042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [parameters: {'id': 'c412ab0e92b348a2be0d0c0699819fe9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:18.130139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 16 00:44:18.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:18.134123 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 182/354] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 16 00:44:17 2022] POST /identity/v3/roles => generated 144 bytes in 339 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:18.134123 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.191288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.191984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.201434 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.202807 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:18.204080 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.207020 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.207196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.236205 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 173/355] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:18.241431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.336737 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98a46-a44a-4079-a87d-109c320dd3b8 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.391081 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.392662 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.393466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.394248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.400205 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fe217-f2f2-480c-a64d-d42fc6eb713e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.412003 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:18.417759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:18.419525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:44:18.421210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:18.424565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 183/356] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:18.424953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.426829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.465868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.467903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.467903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.468519 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.486547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.489041 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:18.513068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:18.515001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:18.516037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:18.516037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:18.516037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:18.520503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 174/357] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:18.520503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.571187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.587408 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d506-4100-48fb-804b-60293eb97ccd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.635775 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.636455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.636737 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.637009 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.637884 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.639728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.673944 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 184/358] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:18 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:18.673944 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.753430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e004-681e-404d-b675-62306da8f7ad None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.847080 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.848237 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.848553 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.849013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.849973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:18.850283 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.855634 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.882365 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 175/359] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:18.890338 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e720c-8d87-4e7e-b0ad-b8f35f034224 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.951459 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664b4e0-bed5-4bf4-82db-ef303a7c3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.952651 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b4e0-bed5-4bf4-82db-ef303a7c3375 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.953179 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b4e0-bed5-4bf4-82db-ef303a7c3375 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.953660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b4e0-bed5-4bf4-82db-ef303a7c3375 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.954571 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664b4e0-bed5-4bf4-82db-ef303a7c3375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:18.955105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664b4e0-bed5-4bf4-82db-ef303a7c3375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.956874 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664b4e0-bed5-4bf4-82db-ef303a7c3375 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.982735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 185/360] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:18.990329 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:19.030078 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:19.161479 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faffa7a-1461-48ae-9c8b-01a511a4c2b5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:19.229147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763ccdb-1ed8-490f-9e37-fb7132bffc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:19.230259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763ccdb-1ed8-490f-9e37-fb7132bffc58 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.230774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763ccdb-1ed8-490f-9e37-fb7132bffc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.231278 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763ccdb-1ed8-490f-9e37-fb7132bffc58 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.233447 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763ccdb-1ed8-490f-9e37-fb7132bffc58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:19.234801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763ccdb-1ed8-490f-9e37-fb7132bffc58 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:19.267711 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 176/361] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:18 2022] POST /identity/v3/users => generated 249 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:20.020802 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cd6d-f7f2-4280-a09a-e6887d6e0f4b None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.021337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cd6d-f7f2-4280-a09a-e6887d6e0f4b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.021337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cd6d-f7f2-4280-a09a-e6887d6e0f4b None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.023114 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 186/362] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:20.028767 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a224-2270-49d4-8e84-7cb5991470d4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.030427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a224-2270-49d4-8e84-7cb5991470d4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.030427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a224-2270-49d4-8e84-7cb5991470d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.036035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef567f-b86d-4256-9861-380823790bd3 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.036377 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef567f-b86d-4256-9861-380823790bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.036621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef567f-b86d-4256-9861-380823790bd3 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.038523 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 187/363] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:20.045368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1bee-2e03-47be-a6e3-9cb174f8f17c None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.045708 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1bee-2e03-47be-a6e3-9cb174f8f17c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.045992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1bee-2e03-47be-a6e3-9cb174f8f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.056105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-54c8a224-2270-49d4-8e84-7cb5991470d4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:20.057393 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-54c8a224-2270-49d4-8e84-7cb5991470d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:20.080463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-1dfe1bee-2e03-47be-a6e3-9cb174f8f17c None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:20.084253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1dfe1bee-2e03-47be-a6e3-9cb174f8f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:20.087072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:20.195267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 177/364] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:20.217740 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 188/365] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:20.584669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8a224-2270-49d4-8e84-7cb5991470d4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:20.599327 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:20.624044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1bee-2e03-47be-a6e3-9cb174f8f17c None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:20.760477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8a224-2270-49d4-8e84-7cb5991470d4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:20.802348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1bee-2e03-47be-a6e3-9cb174f8f17c None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:20.806770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:20.807438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.807729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.808013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.820631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:20.827087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:20.828035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:20.829448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 178/366] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:20.835450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:20.855410 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:20.856065 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.856363 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.856641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.864830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:20.869367 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:20.876932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:20.877882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:20.878658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 189/367] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:20.886021 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:20.987830 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:21.059846 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f48dd-71f3-4af9-9874-0f29b454f5c5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.071562 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730b63-f597-4e51-bb7e-0a0b38d7a778 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.142578 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.144418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.145167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.146172 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.147446 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:21.148488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:21.150705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:21.155141 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.156104 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.156685 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.157161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.158990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] RBAC: Adding query filter params (name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:21.159516 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:21.164128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:21.177025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 179/368] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:21.178321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:21.183821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 190/369] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:21.193458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:21.335272 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:21.391583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a83758-6969-4a4d-be0a-5f8ec39421e9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.415937 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982431a-8f10-4a18-ae28-875a3b39065a None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.471513 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19decd8-efb0-4933-92f5-892cb3be3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.472690 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19decd8-efb0-4933-92f5-892cb3be3577 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.474398 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:21.475776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19decd8-efb0-4933-92f5-892cb3be3577 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.476826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19decd8-efb0-4933-92f5-892cb3be3577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.486006 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.486673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.486955 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.487230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.493776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19decd8-efb0-4933-92f5-892cb3be3577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:21.495705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19decd8-efb0-4933-92f5-892cb3be3577 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:21.501176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:21.502748 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-b19decd8-efb0-4933-92f5-892cb3be3577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:21.514554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:21.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:21.517063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:21.517063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:21.517063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:21.518954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 191/370] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:21.519952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:21.521029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:21.522070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:21.522070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:21.522070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:21.524941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 180/371] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:21.525753 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9744-e36e-4ed0-9d19-ee25b20460de None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.526188 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9744-e36e-4ed0-9d19-ee25b20460de None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.526615 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9744-e36e-4ed0-9d19-ee25b20460de None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.527219 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:21.531097 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 192/372] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:21.532305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b9744-e36e-4ed0-9d19-ee25b20460de None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:21.697488 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b9744-e36e-4ed0-9d19-ee25b20460de None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.705874 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8666b-17fc-448b-be04-394b8735868c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.732540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:21.764917 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.765833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751469-885b-4e66-9e34-1a9063aa8a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.765994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.766411 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.766738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751469-885b-4e66-9e34-1a9063aa8a72 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.766851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.767177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751469-885b-4e66-9e34-1a9063aa8a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.767552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751469-885b-4e66-9e34-1a9063aa8a72 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.767888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:21.768363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:21.768475 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751469-885b-4e66-9e34-1a9063aa8a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:21.768897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751469-885b-4e66-9e34-1a9063aa8a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:21.770436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751469-885b-4e66-9e34-1a9063aa8a72 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:21.770732 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:21.792187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 193/373] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:21.793896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc76-8620-423c-98cf-6522e255d04a None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.794296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc76-8620-423c-98cf-6522e255d04a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.796762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420bc76-8620-423c-98cf-6522e255d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.802924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 181/374] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:21.804189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:21.827091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-7420bc76-8620-423c-98cf-6522e255d04a None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:21.828783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-7420bc76-8620-423c-98cf-6522e255d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:21.869751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:21.943963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb2f6-f20e-4e1f-b4b3-975af7201267 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.958831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 194/375] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:21.959627 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc76-8620-423c-98cf-6522e255d04a None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:21.992944 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484496b7-f0e6-4911-ab61-0d2862d2b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.993968 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484496b7-f0e6-4911-ab61-0d2862d2b63f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.994458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484496b7-f0e6-4911-ab61-0d2862d2b63f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.994934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484496b7-f0e6-4911-ab61-0d2862d2b63f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.004432 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484496b7-f0e6-4911-ab61-0d2862d2b63f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.006923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484496b7-f0e6-4911-ab61-0d2862d2b63f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-484496b7-f0e6-4911-ab61-0d2862d2b63f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:22.022673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.027321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 182/376] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa908b-4825-41d4-87dc-bbf0da2131e5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.031751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa908b-4825-41d4-87dc-bbf0da2131e5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.035107 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa908b-4825-41d4-87dc-bbf0da2131e5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.035107 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 183/377] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:22.037857 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa908b-4825-41d4-87dc-bbf0da2131e5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.111863 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420bc76-8620-423c-98cf-6522e255d04a None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.113740 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.160837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d8564-ed78-4e13-a518-7ed934f8f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.161498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8564-ed78-4e13-a518-7ed934f8f34e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.161784 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8564-ed78-4e13-a518-7ed934f8f34e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.162061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8564-ed78-4e13-a518-7ed934f8f34e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.171611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d8564-ed78-4e13-a518-7ed934f8f34e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.173137 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d8564-ed78-4e13-a518-7ed934f8f34e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-629d8564-ed78-4e13-a518-7ed934f8f34e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:22.198747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.202415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 195/378] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189cc74-80eb-4ada-a412-3f4d45ffbe83 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.204193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189cc74-80eb-4ada-a412-3f4d45ffbe83 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.207022 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189cc74-80eb-4ada-a412-3f4d45ffbe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.233040 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-0189cc74-80eb-4ada-a412-3f4d45ffbe83 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:22.234729 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-0189cc74-80eb-4ada-a412-3f4d45ffbe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:22.303595 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa908b-4825-41d4-87dc-bbf0da2131e5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.307352 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.331395 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 196/379] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:22.337637 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189cc74-80eb-4ada-a412-3f4d45ffbe83 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.385609 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.386637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.387079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.387514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.388842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:22.389562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.392279 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.465537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 184/380] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:22.477499 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.592136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.607794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189cc74-80eb-4ada-a412-3f4d45ffbe83 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.663328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f3dce-df68-4545-b8a5-5dbf5c039348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.663616 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520ac8-1df7-4d44-be51-d554fb5264fd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.664380 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f3dce-df68-4545-b8a5-5dbf5c039348 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.664881 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f3dce-df68-4545-b8a5-5dbf5c039348 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.665330 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f3dce-df68-4545-b8a5-5dbf5c039348 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.666714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f3dce-df68-4545-b8a5-5dbf5c039348 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:22.667250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f3dce-df68-4545-b8a5-5dbf5c039348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.670503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f3dce-df68-4545-b8a5-5dbf5c039348 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.699432 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.700086 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.700399 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.701201 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.712414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.713912 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:22.730203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.731351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:22.734759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:22.734759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:22.734759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:22.734759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 185/381] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:22.734759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.739089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 197/382] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:22.741314 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946c5e8-0ef2-43b1-b3d5-03e249a89d1b None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.741804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946c5e8-0ef2-43b1-b3d5-03e249a89d1b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.742290 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946c5e8-0ef2-43b1-b3d5-03e249a89d1b None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.746795 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 198/383] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:22.748766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946c5e8-0ef2-43b1-b3d5-03e249a89d1b None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.750299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.859048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53476b63-1491-42b0-9d02-fec6a4ae0896 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.884565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946c5e8-0ef2-43b1-b3d5-03e249a89d1b None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.896726 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.897375 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.897660 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.897939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.910097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:22.915151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.917333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 186/384] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:22.919307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.950271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0d2a-f0ff-4dfc-a677-ef335390f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.951406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0d2a-f0ff-4dfc-a677-ef335390f117 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.951897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0d2a-f0ff-4dfc-a677-ef335390f117 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.952392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0d2a-f0ff-4dfc-a677-ef335390f117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.971017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0d2a-f0ff-4dfc-a677-ef335390f117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.973703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0d2a-f0ff-4dfc-a677-ef335390f117 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.995850 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-a63d0d2a-f0ff-4dfc-a677-ef335390f117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:22.996806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.999291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:23.000972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:23.000972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:23.000972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:23.000972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 199/385] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:23.002111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ced6-60cd-4773-b215-e91c34ba743d None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.002811 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ced6-60cd-4773-b215-e91c34ba743d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.003089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ced6-60cd-4773-b215-e91c34ba743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.011632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.025534 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-ede0ced6-60cd-4773-b215-e91c34ba743d None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:23.026784 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-ede0ced6-60cd-4773-b215-e91c34ba743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:23.043588 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c05648-a904-4d36-ac21-eb29fb79796d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.094564 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.095454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.095903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.096395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.114051 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.116685 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.137261 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 200/386] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:23.137261 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ced6-60cd-4773-b215-e91c34ba743d None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:23.151035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:23.152994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:23.155312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:23.155312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:23.155312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:23.160167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 187/387] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:23.161782 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.326761 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742a45-8c62-46b5-a6af-8d709ebe9556 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.330203 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0ced6-60cd-4773-b215-e91c34ba743d None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.370886 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.372392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.382345 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.383167 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.383448 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.383720 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.385294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:23.386610 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.388429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.394353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.395416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.395933 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.396491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.397727 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:23.398291 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.400987 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.414080 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 201/388] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:23.414080 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.422084 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 188/389] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:23.424071 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.562380 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7331c3-83f8-4e81-89a6-2dc9735954a4 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.594220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5025-e00a-4728-9884-8ed8a79a6ee6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.617930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.618567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.618847 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.619236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.619907 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:23.620306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.621713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.636040 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 202/390] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:23.636965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.650040 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.651014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.651506 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.652011 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.653250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:23.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.657056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.689477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 189/391] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:23.689477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.709108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.753888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.780403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5234fc5-19ac-4164-8523-923a4a5ce02f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.824709 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.828069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.828927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.829417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.839634 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.841207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.849560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5470c-7da0-45cf-acf5-316d017935bc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:23.857831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:23.863207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 203/392] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:23.866087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.908216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.908922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.909209 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.909488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.921768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.923497 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:23.950259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:23.952290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:23.953660 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:23.953660 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:23.953660 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:23.953969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 190/393] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:23.955582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.026349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a237-2e78-49ef-9dd2-3b96c6dc0ae6 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.045253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:24.073886 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:24.074815 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:24.075203 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:24.075570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:24.089362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:24.095718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:24.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 204/394] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:24.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.133821 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:24.141504 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f57b-cbbf-4521-9d4f-f933c4d9677e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.202546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:24.203167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:24.203453 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:24.203729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:24.204438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:24.205908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:24.225111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0ce8a-9dad-4383-b9d2-9ef1493e7319 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.250583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 191/395] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:23 2022] POST /identity/v3/users => generated 247 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:24.250583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.271601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:24.272362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:24.272639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:24.272962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:24.282762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:24.284305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:24.297647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:24.299359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 205/396] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:24.301959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.343455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:24.429834 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7690-2596-444a-9873-c95da8465520 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.473277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee155565-dca2-49f5-a16e-9459ec6b2abd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.480412 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:24.481077 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:24.484064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:24.484064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:24.486272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:24.486272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:24.496106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:24.523657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 192/397] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:24.525258 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.536695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:24.537729 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:24.538207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:24.538719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:24.539866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:24.540453 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:24.542978 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:24.556613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:24.570138 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 206/398] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:24.570138 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.707048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d287791-4c3f-4076-b558-7ca211164b01 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.724672 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:24.742469 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331cc95-c841-4266-a0af-a255d5fe093e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.755084 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:24.755703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:24.755991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:24.756245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:24.757528 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:24.757834 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:24.759374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:24.776360 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 193/399] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:24.776360 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.798801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:24.799430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:24.799709 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:24.799990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:24.800720 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:24.801030 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:24.802505 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:24.831437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 207/400] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:24.831437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:24.940610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:24.950295 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed619f-1e1a-4292-961c-95a03e73bb34 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:24.978263 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa463-3569-4c14-a3e2-c807762a5490 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:25.002838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:25.003909 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.004452 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.004947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.019834 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:25.022573 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:25.023957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:25.024918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.025375 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.025871 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/94c3191543bd4843be4f6db40a98122b/roles/06e0d6417d76496f94940bc5222eb2b9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.042884 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=94c3191543bd4843be4f6db40a98122b, role_id=06e0d6417d76496f94940bc5222eb2b9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:25.044932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:25.046920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:25.047821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:44:25.048757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:25.055840 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 208/401] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:25.057500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:25.068882 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 194/402] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:24 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/94c3191543bd4843be4f6db40a98122b/roles/06e0d6417d76496f94940bc5222eb2b9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:25.068882 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:25.085555 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:25.201640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e199-01f9-4bfc-9866-2c79344455d7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:25.255712 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:25.257233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.257732 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.258216 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.272542 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:25.274516 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:25.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:25.293718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:25.294654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:25.294654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:25.294654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:25.301099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6fe86-51e5-49a7-861c-01c6b9248ef7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:25.301856 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 209/403] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:25.303050 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:25.369027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:25.394221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:25.394887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:25.396091 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.397545 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.398293 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/18da5473168d4998bb38de305174819c/roles/06e0d6417d76496f94940bc5222eb2b9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.427963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=18da5473168d4998bb38de305174819c, role_id=06e0d6417d76496f94940bc5222eb2b9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:25.431769 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:25.440223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2576-4faf-4079-b8c3-734a23f3714b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:25.462817 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 195/404] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:25 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/18da5473168d4998bb38de305174819c/roles/06e0d6417d76496f94940bc5222eb2b9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:25.465586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:25.492522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:25.494157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.495195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.496567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.498299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:25.499007 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:25.502500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:25.547914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 210/405] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 16 00:44:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:25.559503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:25.710927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034e56-df14-4438-8dbc-1e34b33446d9 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:25.745136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:25.768672 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9c0f6-16c4-483a-8f24-69fc765eb745 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:25.777159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:25.778293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.780760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.781282 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.796796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:25.798890 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:25.824530 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:25.825386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:25.826872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:25.827711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:25.827711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:25.827711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:25.829206 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 211/406] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:25.829300 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.829575 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.830172 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.831365 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:25.831897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:25.834145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:25.837191 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:25.876810 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 196/407] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:25.889818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:25.948759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.040547 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9571f94-bd91-4a97-a6ba-519498f85572 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.087681 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0adce3-b1bd-4cf1-958c-ba2d7d4d289e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.115201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.115834 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.116119 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.116417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.117079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:26.118348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.120008 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.143305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.143947 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.144230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.144547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.154413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.154929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 212/408] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:26.155854 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.162029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:26.174147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:26.175298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:26.176443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 197/409] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:26.183889 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.255238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.384765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8b747-a1c9-4808-ac8a-862606f14331 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.387141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.414767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc9625-1470-4449-8625-0f8ef7f581d5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.429139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.429787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.430073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.430359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.431194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:26.431428 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.432999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.495097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 198/410] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:26.504793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.540595 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.542189 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.542948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.543700 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.562917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.564300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:26.586386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:26.588034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:26.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 213/411] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:26.625436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.767483 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21342b2-71bd-466a-8924-929101cf736b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.788012 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.808555 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea889-997b-4e79-803e-b9c7a9b7c12f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.881970 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.885717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.887061 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.888213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.918156 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec986f-2dd9-4cdf-a10c-50ab9cb5f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.918776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec986f-2dd9-4cdf-a10c-50ab9cb5f85b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.919063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec986f-2dd9-4cdf-a10c-50ab9cb5f85b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.919867 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec986f-2dd9-4cdf-a10c-50ab9cb5f85b None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.920845 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec986f-2dd9-4cdf-a10c-50ab9cb5f85b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:26.920995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.921235 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec986f-2dd9-4cdf-a10c-50ab9cb5f85b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.922612 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec986f-2dd9-4cdf-a10c-50ab9cb5f85b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.924491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.938043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 214/412] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:26.944346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721aead-7c4b-41f0-a41a-9e8d372248da None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.944346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721aead-7c4b-41f0-a41a-9e8d372248da None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.944346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721aead-7c4b-41f0-a41a-9e8d372248da None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.945641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 215/413] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:26.947683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaf67c-1703-43cd-b41e-b40cfa493d02 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.947991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaf67c-1703-43cd-b41e-b40cfa493d02 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.948254 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaf67c-1703-43cd-b41e-b40cfa493d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:26.967735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:26.969604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:26.971148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:26.971148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:26.971148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:26.971477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-5fdaf67c-1703-43cd-b41e-b40cfa493d02 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:26.971477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-5fdaf67c-1703-43cd-b41e-b40cfa493d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:26.976620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 199/414] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:26.978413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.993938 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:27.084591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 216/415] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:27.084591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaf67c-1703-43cd-b41e-b40cfa493d02 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:27.147912 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bc3f3-b28b-4787-8012-279d23b870f8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.177995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:27.207437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaf67c-1703-43cd-b41e-b40cfa493d02 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.226783 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:27.227971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.227971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.227971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/e94eb5478e41472abf39001b01db4ae6/roles/06e0d6417d76496f94940bc5222eb2b9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.259868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=e94eb5478e41472abf39001b01db4ae6, role_id=06e0d6417d76496f94940bc5222eb2b9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:27.261377 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:27.285357 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:27.286394 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.286906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.287294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.288084 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:27.288421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:27.290238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:27.296400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 200/416] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:26 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/e94eb5478e41472abf39001b01db4ae6/roles/06e0d6417d76496f94940bc5222eb2b9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:27.311736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 217/417] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:27.317893 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:27.431720 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:27.490357 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:27.557367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dc6c1-5bd6-49dc-8fb2-2f12dbd4ca6a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.636264 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:27.638153 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.638986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.639586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.654266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:27.658019 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:27.681922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c96ae-20ff-469a-b44d-ebd2439502b4 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:27.684999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:27.686687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:27.688457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:27.692929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 201/418] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:27.704502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:27.738570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:27.739233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.739522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.739772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.766517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:27.774191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:27.775953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:27.778213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:27.782313 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 218/419] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:27.793610 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:27.805111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:27.899825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0512-57df-4fdc-a106-b0e5cbaccf90 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.929599 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:27.967328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1da918-256f-4f72-ba98-0674d8895d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:27.968965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da918-256f-4f72-ba98-0674d8895d41 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.969443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da918-256f-4f72-ba98-0674d8895d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.969911 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da918-256f-4f72-ba98-0674d8895d41 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.971113 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1da918-256f-4f72-ba98-0674d8895d41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:27.971657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1da918-256f-4f72-ba98-0674d8895d41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:27.974829 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1da918-256f-4f72-ba98-0674d8895d41 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:27.992422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 202/420] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:27.994037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653fab-f835-4aa8-bb2f-a33e92151dbc None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.994524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653fab-f835-4aa8-bb2f-a33e92151dbc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.994993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653fab-f835-4aa8-bb2f-a33e92151dbc None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.995122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c2ba-2c83-440b-a85e-44f0aeeb5834 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.997214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 203/421] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:27.998315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653fab-f835-4aa8-bb2f-a33e92151dbc None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:28.048384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7192d86-36cf-4d1f-aaec-e031168e5287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:28.049434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7192d86-36cf-4d1f-aaec-e031168e5287 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.049711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7192d86-36cf-4d1f-aaec-e031168e5287 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.049987 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7192d86-36cf-4d1f-aaec-e031168e5287 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.050952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7192d86-36cf-4d1f-aaec-e031168e5287 None admin] RBAC: Adding query filter params (name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:28.051263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7192d86-36cf-4d1f-aaec-e031168e5287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:28.052990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7192d86-36cf-4d1f-aaec-e031168e5287 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:28.069293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 219/422] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:28.069293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273d40a-7578-4179-938f-6c5a61e362fa None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.069293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273d40a-7578-4179-938f-6c5a61e362fa None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.069293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273d40a-7578-4179-938f-6c5a61e362fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.095574 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-e273d40a-7578-4179-938f-6c5a61e362fa None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:28.096897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e273d40a-7578-4179-938f-6c5a61e362fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:28.138037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653fab-f835-4aa8-bb2f-a33e92151dbc None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:28.183260 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:28.190408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:28.191540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.192087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.192763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/aaaeca0952f04f229b9d53ce1625a1d5/roles/06e0d6417d76496f94940bc5222eb2b9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.208340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 220/423] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:28.208340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273d40a-7578-4179-938f-6c5a61e362fa None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:28.227422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=aaaeca0952f04f229b9d53ce1625a1d5, role_id=06e0d6417d76496f94940bc5222eb2b9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:28.229063 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:28.254643 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 204/424] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:27 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/aaaeca0952f04f229b9d53ce1625a1d5/roles/06e0d6417d76496f94940bc5222eb2b9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:28.395861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273d40a-7578-4179-938f-6c5a61e362fa None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:28.461899 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:28.463024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.463543 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.464048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.486404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:28.489174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:28.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:28.518172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:28.518172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:28.518172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:28.518334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 221/425] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:28.528022 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:28.578111 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:28.589067 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:28.716607 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:28.752927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c921f2-4bea-45c0-8b61-1c6995abda1d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:28.798768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052f010-9624-4acd-92ba-11e299a101e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:28.799414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052f010-9624-4acd-92ba-11e299a101e3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.799709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052f010-9624-4acd-92ba-11e299a101e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.799962 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052f010-9624-4acd-92ba-11e299a101e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.800666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052f010-9624-4acd-92ba-11e299a101e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:28.800971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052f010-9624-4acd-92ba-11e299a101e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:28.802379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052f010-9624-4acd-92ba-11e299a101e3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:28.820487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 205/426] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:28.822795 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7bae-8ad8-4908-bd6f-8e23865015a1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.823308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7bae-8ad8-4908-bd6f-8e23865015a1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.823752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7bae-8ad8-4908-bd6f-8e23865015a1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.832463 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 206/427] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:28.836693 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7bae-8ad8-4908-bd6f-8e23865015a1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:28.855841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de382-deb5-4955-b8a3-b9a739e74acb None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:28.920691 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39efd21-9da0-404e-8446-46d02f70a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:28.921762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39efd21-9da0-404e-8446-46d02f70a628 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.922246 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39efd21-9da0-404e-8446-46d02f70a628 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.922724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39efd21-9da0-404e-8446-46d02f70a628 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.945151 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39efd21-9da0-404e-8446-46d02f70a628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-d39efd21-9da0-404e-8446-46d02f70a628 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:28.956839 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:28.958384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:28.959992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:28.964427 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 222/428] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:28.967514 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645b7e-b90a-48da-88c5-c70718324673 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:28.967949 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645b7e-b90a-48da-88c5-c70718324673 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:28.968470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645b7e-b90a-48da-88c5-c70718324673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:28.999623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:29.009058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-e4645b7e-b90a-48da-88c5-c70718324673 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:29.011028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e4645b7e-b90a-48da-88c5-c70718324673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:29.020109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7bae-8ad8-4908-bd6f-8e23865015a1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:29.066811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:29.067838 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.068305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.068818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.078040 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:29.081883 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:29.096626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:29.097614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:29.098536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:29.100935 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 207/429] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:29.101956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.162422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 223/430] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:29.164149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4645b7e-b90a-48da-88c5-c70718324673 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.222468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de5e69-6533-414d-96d9-aa7771594afb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:29.234645 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:29.306402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:29.307100 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.307435 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.307783 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.308929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:29.309456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:29.321787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:29.342951 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 208/431] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:29.349007 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.362966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:29.412487 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4645b7e-b90a-48da-88c5-c70718324673 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:29.511580 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:29.512306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.512777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.514094 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.515714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:29.516233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:29.519413 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:29.544510 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 224/432] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 16 00:44:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:29.546579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.584946 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9b0a2-d463-4253-a1f2-3eeab8fcb043 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:29.670469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:29.671444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.672151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.672812 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.690090 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:29.704062 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:29.705217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c3ad4-5708-41b7-9a6e-37836fa916e4 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:29.705957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:29.728582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:29.730396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:29.732138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:29.732138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:29.732138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:29.735775 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 209/433] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:29.737142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.782959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:29.784660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.785496 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.786311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.806891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:29.826490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:29.828954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:29.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:29.834834 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 225/434] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:29.838838 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:29.844723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.896759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827de1-0b8a-43fb-be7d-81e85fe98925 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:29.976236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:29.977659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.978234 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.978801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.009621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.012502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:30.056689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:30.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:30.060636 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:30.060636 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:30.060636 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:30.069980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 210/435] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:30.070874 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:30.090998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae25e0-76dc-4896-bcaa-f40a1d178d18 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:30.146020 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a2c8-763c-4171-9d45-f04f7d82dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:30.146641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a2c8-763c-4171-9d45-f04f7d82dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.146920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a2c8-763c-4171-9d45-f04f7d82dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.147195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a2c8-763c-4171-9d45-f04f7d82dcd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.147843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8a2c8-763c-4171-9d45-f04f7d82dcd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:30.148148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8a2c8-763c-4171-9d45-f04f7d82dcd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.149787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8a2c8-763c-4171-9d45-f04f7d82dcd5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.169078 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 226/436] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:30.169078 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e914a-5f42-4f7a-a2c5-a751b330d9a3 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.169078 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e914a-5f42-4f7a-a2c5-a751b330d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.169078 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e914a-5f42-4f7a-a2c5-a751b330d9a3 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.169078 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 227/437] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:30.169078 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e914a-5f42-4f7a-a2c5-a751b330d9a3 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:30.192677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:30.260728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c076fc-ca52-473e-86ae-dc714e14a13f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:30.288627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:30.325579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e914a-5f42-4f7a-a2c5-a751b330d9a3 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:30.340095 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bd568-dc83-4ea9-96fe-616bd5b1f245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:30.340774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd568-dc83-4ea9-96fe-616bd5b1f245 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.342037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd568-dc83-4ea9-96fe-616bd5b1f245 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.342195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd568-dc83-4ea9-96fe-616bd5b1f245 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.343168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bd568-dc83-4ea9-96fe-616bd5b1f245 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:30.343679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bd568-dc83-4ea9-96fe-616bd5b1f245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.346490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bd568-dc83-4ea9-96fe-616bd5b1f245 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.360894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 211/438] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:30.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99035-e4d5-497d-a27c-71a5b7392166 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99035-e4d5-497d-a27c-71a5b7392166 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.362880 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99035-e4d5-497d-a27c-71a5b7392166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.392211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-63e99035-e4d5-497d-a27c-71a5b7392166 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:30.393469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-63e99035-e4d5-497d-a27c-71a5b7392166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:30.393646 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:30.394472 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.394968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.395332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.396301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:30.397871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.399046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.432394 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 228/439] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:30.432394 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:30.552522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 212/440] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:30.552522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99035-e4d5-497d-a27c-71a5b7392166 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:30.574455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:30.623274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503514bc-5b74-4192-9569-29c4418be61f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:30.690529 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:30.692100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.692840 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.693367 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.708916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.709742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99035-e4d5-497d-a27c-71a5b7392166 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:30.712161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.714446 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:30.731294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:30.732965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:30.733954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:30.737519 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 229/441] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 16 00:44:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:30.738746 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:30.783181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:30.783952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.784422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.784786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.802914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.805021 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:30.827207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:30.828174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:30.829052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:30.829052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:30.829052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:30.829318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 213/442] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:30.831671 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:30.866209 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c4402-2905-4d09-b0f1-a90f26f05797 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:30.904875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:30.905496 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.905725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.906017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.909090 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:30.914587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.916274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:30.929861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:30.930787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:30.931639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 230/443] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:30.932457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:30.978508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d04e2-33ae-489a-9273-480d0de59ab8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.022119 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.023361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.023882 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.024407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.025798 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:31.026361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:31.030325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:31.061843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 214/444] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 16 00:44:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:31.063529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:31.074001 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771ff81-42e1-4897-ac57-1876b3d157c1 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.083183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:31.117298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008482ee-b781-475d-90d7-f015e08643c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.117910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008482ee-b781-475d-90d7-f015e08643c0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.118198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008482ee-b781-475d-90d7-f015e08643c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.118470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008482ee-b781-475d-90d7-f015e08643c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.119132 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008482ee-b781-475d-90d7-f015e08643c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:31.119421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008482ee-b781-475d-90d7-f015e08643c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:31.120872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008482ee-b781-475d-90d7-f015e08643c0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:31.142893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 231/445] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:31.142893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928762-6c2a-483f-8e02-6716ad72a934 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.142893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928762-6c2a-483f-8e02-6716ad72a934 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.142893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928762-6c2a-483f-8e02-6716ad72a934 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.142893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 232/446] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:31.142893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928762-6c2a-483f-8e02-6716ad72a934 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:31.181447 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaddee9-7fd3-4059-95b8-a69a22356155 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.206297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:31.226958 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.227148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.227374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.227612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.243818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:31.253837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:31.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:31.256907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 215/447] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:31.259834 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:31.260063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928762-6c2a-483f-8e02-6716ad72a934 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.300775 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.301390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.301667 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.302616 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:31.302916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:31.304366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:31.317204 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 233/448] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:31.318048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:31.363121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:31.393781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c311-7e0f-40b5-9bbb-bfe14ad9aaf8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.431849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.432422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.432703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.432981 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.453115 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918a57a-de9e-4362-830d-eb23f8dcd201 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.476585 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:31.501023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec5bb-632b-4714-95c5-90b470d217cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.501835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec5bb-632b-4714-95c5-90b470d217cf None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.502272 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec5bb-632b-4714-95c5-90b470d217cf None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.502717 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec5bb-632b-4714-95c5-90b470d217cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.514276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec5bb-632b-4714-95c5-90b470d217cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:31.516199 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec5bb-632b-4714-95c5-90b470d217cf None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:31.520687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:31.523601 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-780ec5bb-632b-4714-95c5-90b470d217cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:31.530362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:31.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 234/449] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ca91-a2aa-4e74-acf4-ffffb5ee157c None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.534412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ca91-a2aa-4e74-acf4-ffffb5ee157c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.535835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ca91-a2aa-4e74-acf4-ffffb5ee157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.555351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-a826ca91-a2aa-4e74-acf4-ffffb5ee157c None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:31.557360 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a826ca91-a2aa-4e74-acf4-ffffb5ee157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:31.648952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:31.657200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 235/450] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:31.658929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826ca91-a2aa-4e74-acf4-ffffb5ee157c None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:31.706818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 216/451] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:31.706818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:31.805427 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826ca91-a2aa-4e74-acf4-ffffb5ee157c None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.819972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:31.863409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf718b2-4638-4c2d-9a00-167464bc867e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:31.865686 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.866321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.866667 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.867062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.867751 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] RBAC: Adding query filter params (name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:31.868062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:31.869501 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:31.880354 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 236/452] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:31.881608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:31.936797 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:31.937967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:31.938476 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:31.938984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/ad81ce2fa0644dae929e51279b7f9b76/roles/06e0d6417d76496f94940bc5222eb2b9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:31.957907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=ad81ce2fa0644dae929e51279b7f9b76, role_id=06e0d6417d76496f94940bc5222eb2b9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:31.959575 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:31.974527 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 217/453] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:31 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/ad81ce2fa0644dae929e51279b7f9b76/roles/06e0d6417d76496f94940bc5222eb2b9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:31.975922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.030924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.060948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ad87-2496-4e3a-8356-3e83c01eb733 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.125707 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.126664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.127738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.128199 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.129754 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:32.130313 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.132761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.172349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 237/454] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 16 00:44:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:32.172349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.180251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51a49-7382-4f4a-a8f4-cdfb7b3e4854 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.201540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.245953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.246716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.247069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.247513 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.260255 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.261948 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:32.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:32.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:32.284510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:32.284510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:32.284510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:32.284510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 218/455] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:32.288141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.331618 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a214-ad73-48d9-ad91-614af25733ad None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.377945 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.378664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.378844 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.379134 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.391402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.391654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.393413 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:32.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:32.414412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:32.416349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:32.416349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:32.416349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:32.417841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 238/456] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:32.418637 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3226651-c810-427a-826e-c1a1332a8139 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.472710 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.473358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.473642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.473949 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.487967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:32.493418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:32.494395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:32.495236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 219/457] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:32.495903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.535267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.578662 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e97825-a05a-4d4b-a0d0-32ce8733f50d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.628512 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f713d-39ed-4f23-aad1-68669434e4ba None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.639819 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.640772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.641186 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.641609 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.672301 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.673476 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.673978 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.674467 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.675499 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:32.676027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.677816 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.680868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.698789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 220/458] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:32.698789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.772407 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.774169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.823034 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3d40a-0b16-4ffd-ae66-0d623d026f9c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.866788 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.868272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.868785 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.869238 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.870105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:32.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.871858 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.891038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 221/459] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:32.892050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.919145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.962150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 239/460] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:32.963760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.977832 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.066166 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95032b-1937-4091-b89e-0fa0e5737d29 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.130739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.131773 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.132268 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.132782 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.133984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:33.134170 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ca5dc-fdff-4bda-be9f-12b0c86752d4 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.134535 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.139646 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.158660 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 222/461] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:33.160110 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.181384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367875-184a-434c-94b2-9afffad6737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.182037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367875-184a-434c-94b2-9afffad6737d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.182315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367875-184a-434c-94b2-9afffad6737d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.182587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367875-184a-434c-94b2-9afffad6737d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.191173 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367875-184a-434c-94b2-9afffad6737d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.192682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367875-184a-434c-94b2-9afffad6737d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-49367875-184a-434c-94b2-9afffad6737d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:33.208803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:33.210809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 240/462] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:33.212493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367875-184a-434c-94b2-9afffad6737d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.284936 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.361614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c55a-de06-4e17-86f5-9edc6ee61f2a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.364046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367875-184a-434c-94b2-9afffad6737d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.398042 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.407705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.408683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.409318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.409813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.422876 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.424626 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.428621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.429692 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.430174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.430657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:33.443989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:33.445195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:33.446165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:33.446165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:33.446165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:33.446359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.448695 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.452426 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 241/463] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:33.453351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:33.472256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:33.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:44:33.476328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:33.479623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 223/464] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:33.481344 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.608027 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.623659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32fca1-a370-4b0a-b6e3-e21a2b93135c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.629288 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848452a4-d11a-4cf8-b877-fde64ed61de7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.666191 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.666819 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.667113 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.667381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.668090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:33.668435 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.670075 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.692864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 224/465] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:33.692864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.698081 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.699108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.699672 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.700130 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.719201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.721505 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:33.745995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:33.746988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:33.747910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:33.747910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:33.747910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:33.753216 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 242/466] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:33.753216 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.767867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.856259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84c97-c8b4-4cfc-8733-7097164b512a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.871883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5981209-21f1-42ad-ab71-9a1b94fc031c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.917531 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.918141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.918335 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.918690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.919325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:33.922149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.923604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.932771 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.933574 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.933985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.934395 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.935356 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:33.935798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.937660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.939162 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 225/467] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:33.944260 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.964923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 243/468] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:33.968649 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.071840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:34.077276 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35998ab-5e79-4c7a-b423-6f90a5f9d640 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:34.098567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065099-bc1a-4e38-8738-1629e87ba1cc None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:34.121426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:34.122047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.122612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.122612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.123494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] RBAC: Adding query filter params (role.id=06e0d6417d76496f94940bc5222eb2b9, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=94c3191543bd4843be4f6db40a98122b) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:34.123811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:34.125330 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:34.132396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 226/469] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/role_assignments?user.id=94c3191543bd4843be4f6db40a98122b&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=06e0d6417d76496f94940bc5222eb2b9 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:34.141264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:34.141995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.142343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.142682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.143434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:34.143812 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:34.145318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.145496 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:34.168591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 244/470] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:34.168591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.281522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:34.359343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1a9d1-c46a-4fa3-ae65-700bdab6e69f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:34.363350 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846fe5c-ab9a-4409-9a9a-91d583ec2c7c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:34.401483 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:34.402326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.402502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.402650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.407394 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:34.408019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.408326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.408634 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.416964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:34.421183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:34.437306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:34.438241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:34.439073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 227/471] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:34.440006 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.469889 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:34.525836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:34.527522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:34.579505 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ef8dd-95fd-4302-8cbf-2b36f34660d6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:34.595156 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:34.633291 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:34.634694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.635414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.635848 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.647046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:34.648812 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:34.650341 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 245/472] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:34.651536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:34.666364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:34.667522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:44:34.668666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:34.676604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 228/473] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:34.677679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.788226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61440-e787-4344-b883-ea3444632799 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:34.791960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:34.815182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4a82-f96a-4785-b80d-e4f535ccf8cc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:34.855391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968abe-c18e-4730-826d-13f6fa5eb532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:34.856037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968abe-c18e-4730-826d-13f6fa5eb532 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.856400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968abe-c18e-4730-826d-13f6fa5eb532 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.857217 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968abe-c18e-4730-826d-13f6fa5eb532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.857804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:34.858830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.859334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.859831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.861170 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:34.861698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:34.864457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:34.870502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968abe-c18e-4730-826d-13f6fa5eb532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:34.872159 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968abe-c18e-4730-826d-13f6fa5eb532 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:34.883685 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 246/474] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:34.887297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-51968abe-c18e-4730-826d-13f6fa5eb532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:34.892555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:34.894409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:34.896065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:34.896065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:34.896065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:34.896065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 229/475] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:34.896065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb913b6-ee5a-41a9-9e66-cb3d869a01a6 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:34.896065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb913b6-ee5a-41a9-9e66-cb3d869a01a6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:34.896065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb913b6-ee5a-41a9-9e66-cb3d869a01a6 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:34.904168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 230/476] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:34.904168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb913b6-ee5a-41a9-9e66-cb3d869a01a6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:34.930556 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:35.039389 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821dc28-97fa-4e9b-be71-710202e503b0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:35.062589 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb913b6-ee5a-41a9-9e66-cb3d869a01a6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:35.089283 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:35.090138 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.090559 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.091530 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.092455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:35.092840 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:35.094779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:35.119829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 247/477] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Oct 16 00:44:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:35.121335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:35.136602 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456ef1a-3c3a-4935-b681-6b7ce331e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:35.137564 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456ef1a-3c3a-4935-b681-6b7ce331e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.138108 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456ef1a-3c3a-4935-b681-6b7ce331e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.139053 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456ef1a-3c3a-4935-b681-6b7ce331e2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.140392 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456ef1a-3c3a-4935-b681-6b7ce331e2c2 None admin] RBAC: Adding query filter params (role.id=06e0d6417d76496f94940bc5222eb2b9, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=18da5473168d4998bb38de305174819c) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:35.141380 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456ef1a-3c3a-4935-b681-6b7ce331e2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:35.143959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456ef1a-3c3a-4935-b681-6b7ce331e2c2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:35.147301 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:35.166496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 231/478] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:34 2022] GET /identity/v3/role_assignments?user.id=18da5473168d4998bb38de305174819c&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=06e0d6417d76496f94940bc5222eb2b9 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:35.166496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7615a9-8b0b-402f-b451-e4d9cc458b1a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.166496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7615a9-8b0b-402f-b451-e4d9cc458b1a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.166496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7615a9-8b0b-402f-b451-e4d9cc458b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.186803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-8d7615a9-8b0b-402f-b451-e4d9cc458b1a None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:35.188379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8d7615a9-8b0b-402f-b451-e4d9cc458b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:35.313481 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:35.330591 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 232/479] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:35.332659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7615a9-8b0b-402f-b451-e4d9cc458b1a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:35.385620 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcd16-2af4-4533-a8e4-ca29e364f04e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:35.503823 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:35.504821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.505324 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.505846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.507050 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:35.507600 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:35.510406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:35.543826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 248/480] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:35.551214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:35.606325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7615a9-8b0b-402f-b451-e4d9cc458b1a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:35.670231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:35.695861 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:35.697108 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.697812 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.698326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.782627 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461443ad-ed16-457d-be62-3c67691029e7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:35.837319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:35.840147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:35.862988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:35.863984 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.864983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.878824 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:35.881459 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:35.884767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:35.906698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:35.908463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:35.910108 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 249/481] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:35.928803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.031412 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 233/482] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:36.032622 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.082307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.148673 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a09bb-8b33-4164-899c-8d0247cfece1 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.218142 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.224940 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.225844 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.226743 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.228255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:36.228977 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.230501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a8d8-c13b-4efe-8324-00350d7d896d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.232720 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.257458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 250/483] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:36.259236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.306310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.307382 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.307804 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.308207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.328471 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:36.338090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:36.339109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:36.339898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:36.340531 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 234/484] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:36.342635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.374887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.451679 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd351b92-a2eb-4065-b449-72c024b1df1d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.478134 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.500664 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcf6f-4520-4d8d-bd39-8ac8c84f5dbe None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.524681 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.525329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.525604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.525918 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.539465 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.541315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:36.560723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:36.562491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:36.564191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:36.564191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:36.564191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:36.564191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 251/485] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:36.564191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.571683 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.572967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.573785 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.574393 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.576043 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] RBAC: Adding query filter params (role.id=06e0d6417d76496f94940bc5222eb2b9, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=e94eb5478e41472abf39001b01db4ae6) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:36.576825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.579826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.592720 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 235/486] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/role_assignments?user.id=e94eb5478e41472abf39001b01db4ae6&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=06e0d6417d76496f94940bc5222eb2b9 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:36.594553 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.695594 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03d03-68f2-42e2-8820-45f6a9f1f6c6 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.716449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.821431 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.822537 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.822968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.823360 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.824706 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:36.825032 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.828015 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.845668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 252/487] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:36.847699 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a276ed-1641-4652-8e90-cd82ea7acfaa None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.851377 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.917985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.919906 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.920263 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.920678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.922157 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:36.922788 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.925622 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 236/488] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:36.973380 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.995309 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b2373-2ebe-4735-aed4-6f20e778bb89 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:37.005450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:37.037740 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b19d9-9e1b-4edf-9cc9-4cc17ad2aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:37.038378 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b19d9-9e1b-4edf-9cc9-4cc17ad2aea7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:37.038660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b19d9-9e1b-4edf-9cc9-4cc17ad2aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:37.038927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b19d9-9e1b-4edf-9cc9-4cc17ad2aea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:37.051621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b19d9-9e1b-4edf-9cc9-4cc17ad2aea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:37.053176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b19d9-9e1b-4edf-9cc9-4cc17ad2aea7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-f09b19d9-9e1b-4edf-9cc9-4cc17ad2aea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:37.094536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:37.097833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:37.100990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:37.100990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:37.100990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:37.100990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 253/489] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:37.100990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7225f-092a-46e6-a31b-8adcbfa2ffe1 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:37.102201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7225f-092a-46e6-a31b-8adcbfa2ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:37.102201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7225f-092a-46e6-a31b-8adcbfa2ffe1 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:37.105945 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 254/490] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:37.108258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7225f-092a-46e6-a31b-8adcbfa2ffe1 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:37.128669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e0af0-578a-401b-82cc-0f5ed4fa3a51 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:37.169819 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:37.215002 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ccbc-2e8b-465e-879f-3b4d29c611e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:37.217277 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ccbc-2e8b-465e-879f-3b4d29c611e2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:37.218597 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ccbc-2e8b-465e-879f-3b4d29c611e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:37.219226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ccbc-2e8b-465e-879f-3b4d29c611e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:37.233613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080ccbc-2e8b-465e-879f-3b4d29c611e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:37.236715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080ccbc-2e8b-465e-879f-3b4d29c611e2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7080ccbc-2e8b-465e-879f-3b4d29c611e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:37.262284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:37.264026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:37.266494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 237/491] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:37.267636 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528582-308b-455b-a611-4f553171028e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:37.267787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528582-308b-455b-a611-4f553171028e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:37.268974 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528582-308b-455b-a611-4f553171028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:37.303916 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-49528582-308b-455b-a611-4f553171028e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:37.306042 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-49528582-308b-455b-a611-4f553171028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:37.346730 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7225f-092a-46e6-a31b-8adcbfa2ffe1 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:37.415068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:37.416155 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:37.416794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:37.417370 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:37.418639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:37.419288 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:37.422362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:37.449830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 255/492] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:37.449830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:37.451231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 238/493] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:37.453136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49528582-308b-455b-a611-4f553171028e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:37.464351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:37.745861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:37.786257 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49528582-308b-455b-a611-4f553171028e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:37.813278 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744d0d-ddef-4d74-ba43-e0fc34497cde None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:37.849148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:37.850282 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:37.850772 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:37.851258 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:37.882945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:37.885690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:37.932540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:37.934381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:37.937449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:37.938726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:37.938726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:37.938726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:37.938726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:37.940352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:37.940352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:37.942970 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:37.946279 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 239/494] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 494 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:37.947877 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:37.992927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 256/495] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:37.999681 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:38.134998 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:38.224250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3096-cce9-45b8-a1cf-c5c67cda3be1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:38.236395 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0df2b2-6c93-4fcd-9baa-be6bd47779f5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:38.280444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:38.281424 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:38.282024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:38.282507 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:38.283560 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] RBAC: Adding query filter params (role.id=06e0d6417d76496f94940bc5222eb2b9, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=aaaeca0952f04f229b9d53ce1625a1d5) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:38.284102 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:38.285965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:38.291646 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:38.292676 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:38.293152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:38.293610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:38.300359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:38.300359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:38.300359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:38.301073 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 257/496] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:37 2022] GET /identity/v3/role_assignments?user.id=aaaeca0952f04f229b9d53ce1625a1d5&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=06e0d6417d76496f94940bc5222eb2b9 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:38.302379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:38.327724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:38.336860 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 240/497] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 16 00:44:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:38.349499 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:38.562620 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af163b63-b769-4aa8-98e1-fba4f4cf9d8a None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:38.569778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4c640-6b3c-48e8-ab67-2a02ed2fa4bb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:38.613301 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:38.654178 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:38.655283 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:38.655793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:38.656299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:38.657436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:38.658803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:38.659601 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:38.660402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:38.679897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:38.690785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:38.693375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:38.695048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 258/498] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:38.706299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:38.823114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:38.825955 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:38.853567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:38.942742 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2d17-e0d2-42b6-a4f6-7f79d6d889da None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.029349 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 241/499] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:44:39.037945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:39.051318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:39.052913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.053403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.053907 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.055103 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:39.055639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:39.058368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:39.072714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:39.091666 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 259/500] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:39.100621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:39.213097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9da0d-d153-401e-af43-f40cb95ee20a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.290922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530140b7-c311-4c30-a8a7-09a90c3cd9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:39.292541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530140b7-c311-4c30-a8a7-09a90c3cd9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.294127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530140b7-c311-4c30-a8a7-09a90c3cd9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.294837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530140b7-c311-4c30-a8a7-09a90c3cd9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.313833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530140b7-c311-4c30-a8a7-09a90c3cd9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:39.317267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530140b7-c311-4c30-a8a7-09a90c3cd9e9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:39.339820 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777882a-f011-4afb-bd97-3ebb9cd25c36 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-530140b7-c311-4c30-a8a7-09a90c3cd9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:39.356559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:39.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:39.360863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:39.360863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:39.360863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:39.364434 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 242/501] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:39.367126 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14471-39b5-43cd-8d2b-1c1b227ad7b1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.368287 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14471-39b5-43cd-8d2b-1c1b227ad7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.369093 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14471-39b5-43cd-8d2b-1c1b227ad7b1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.373741 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 243/502] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:39.376427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d14471-39b5-43cd-8d2b-1c1b227ad7b1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:39.397528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:39.410533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1574ae-01fb-4137-90da-21aa2a64c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:39.411562 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1574ae-01fb-4137-90da-21aa2a64c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.412139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1574ae-01fb-4137-90da-21aa2a64c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.412779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1574ae-01fb-4137-90da-21aa2a64c4f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.436027 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1574ae-01fb-4137-90da-21aa2a64c4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:39.439066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1574ae-01fb-4137-90da-21aa2a64c4f8 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-aa1574ae-01fb-4137-90da-21aa2a64c4f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:39.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:39.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:39.478959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:39.478959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:39.478959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:39.483935 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 260/503] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:39.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685745e-ab5b-44a2-8bc9-0a5b3564c19f None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.487621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685745e-ab5b-44a2-8bc9-0a5b3564c19f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.488672 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685745e-ab5b-44a2-8bc9-0a5b3564c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.527618 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-c685745e-ab5b-44a2-8bc9-0a5b3564c19f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:39.529977 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c685745e-ab5b-44a2-8bc9-0a5b3564c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:39.542252 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:39.613953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d14471-39b5-43cd-8d2b-1c1b227ad7b1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.678005 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 261/504] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:39.679849 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685745e-ab5b-44a2-8bc9-0a5b3564c19f None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:39.714186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:39.715801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.716457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.717309 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:39.719536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:39.722367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:39.767208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 244/505] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:39.773391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:39.908781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685745e-ab5b-44a2-8bc9-0a5b3564c19f None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.940136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:39.971845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81992-a368-4e99-a5a3-45b6a240b28e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.984232 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbe803-4a79-40b2-a676-4323e5263d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:39.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe803-4a79-40b2-a676-4323e5263d0a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.986021 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe803-4a79-40b2-a676-4323e5263d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.986601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe803-4a79-40b2-a676-4323e5263d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.987751 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbe803-4a79-40b2-a676-4323e5263d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:39.988447 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbe803-4a79-40b2-a676-4323e5263d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:39.991128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbe803-4a79-40b2-a676-4323e5263d0a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.005453 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:40.012428 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672d38c-243e-46b2-98ab-2dd50b3efe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.014406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672d38c-243e-46b2-98ab-2dd50b3efe3f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.014873 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672d38c-243e-46b2-98ab-2dd50b3efe3f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.015327 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672d38c-243e-46b2-98ab-2dd50b3efe3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.021311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 262/506] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:40.021311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440534-8d1f-4c28-8817-ab0d13573e42 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.021311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440534-8d1f-4c28-8817-ab0d13573e42 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.021311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440534-8d1f-4c28-8817-ab0d13573e42 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.023105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 263/507] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:40.028011 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440534-8d1f-4c28-8817-ab0d13573e42 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.033694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672d38c-243e-46b2-98ab-2dd50b3efe3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.035402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672d38c-243e-46b2-98ab-2dd50b3efe3f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a672d38c-243e-46b2-98ab-2dd50b3efe3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:40.048049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:40.049031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:40.049907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 245/508] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:40.050842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f0d1-1d1a-4a0e-bdd9-106aea66bde1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.052363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f0d1-1d1a-4a0e-bdd9-106aea66bde1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.052363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f0d1-1d1a-4a0e-bdd9-106aea66bde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.071371 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1739f0d1-1d1a-4a0e-bdd9-106aea66bde1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:40.072632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1739f0d1-1d1a-4a0e-bdd9-106aea66bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:40.173941 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440534-8d1f-4c28-8817-ab0d13573e42 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.184944 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 246/509] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:40.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f0d1-1d1a-4a0e-bdd9-106aea66bde1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.256273 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.257473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.258018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.258590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.273179 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.276084 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:40.299277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:40.300435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:40.301403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:40.308894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 264/510] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:40.311037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.317424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f0d1-1d1a-4a0e-bdd9-106aea66bde1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.353020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:40.361435 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.362665 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.363105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.363529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.374044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:40.379791 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.382780 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:40.399954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:40.401009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:40.401890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:40.401890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:40.401890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:40.404758 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 247/511] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:40.406632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.504563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead234b-7e11-4315-87a7-0a3f73cf4780 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.534598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7d7f3-e7ec-4d2d-8482-0ee464dd7de8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.547556 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.548754 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.549336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.549719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:40.551093 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.553055 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.569225 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 265/512] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:40.570191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.581541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.582167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.582446 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.582728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.583486 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:40.583799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.585571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.608216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 248/513] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:40.609131 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.646693 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:40.701396 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:40.717384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee70e3-a3f7-4897-852b-6ddd91e95ee1 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.736054 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba5f6-048d-4366-bee6-bbba3c8c6fa7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.764869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.765694 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.766109 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.766513 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.767416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:40.768043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.769798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.776429 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.777087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.777371 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.777640 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.778313 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.779859 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.791223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 266/514] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:40.791223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:40.792350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:40.794367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:40.795885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 249/515] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:40.797543 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.929146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27061793-7af0-4237-82c3-c7b0388523d5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.930439 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:40.940728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e3a3-ff8f-4286-9e48-15c3a9bdd752 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:40.977943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.978577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.978924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.979270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:40.980017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] RBAC: Adding query filter params (role.id=06e0d6417d76496f94940bc5222eb2b9, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=ad81ce2fa0644dae929e51279b7f9b76) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:40.980352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:40.982793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:40.989880 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 267/516] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/role_assignments?user.id=ad81ce2fa0644dae929e51279b7f9b76&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=06e0d6417d76496f94940bc5222eb2b9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:40.994177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:40.994570 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:40.995537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:40.996004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:40.996512 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.018950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:41.022308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:41.039394 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:41.049734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:41.051608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:41.053375 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:41.053375 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:41.053375 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:41.060294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 250/517] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:41.061939 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:41.205958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4704a60-7e44-4be8-95fa-a19a0a98b9ad None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:41.245742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf767c-d73f-4bfd-a1b0-c26d552609be None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:41.267946 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:41.268717 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.269142 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.269360 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.270061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:41.271580 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:41.309501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:41.311528 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.312264 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.313154 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.314782 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:41.315569 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:41.318544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:41.319542 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 268/518] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:40 2022] POST /identity/v3/users => generated 254 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:41.320925 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:41.330166 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 251/519] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 16 00:44:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:41.338121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:41.368781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:41.504756 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:41.533694 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323437cd-3507-40c0-92a0-252f8328067a None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:41.540201 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94198f-b35e-4554-af45-8b31ccab51b3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:41.593149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:41.594868 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.594868 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.594868 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.595611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:41.595925 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:41.597382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:41.598737 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f04148-d149-4265-9373-eac133553fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:41.599358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04148-d149-4265-9373-eac133553fcd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.599635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04148-d149-4265-9373-eac133553fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04148-d149-4265-9373-eac133553fcd None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.600595 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f04148-d149-4265-9373-eac133553fcd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:41.600903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f04148-d149-4265-9373-eac133553fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:41.602297 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f04148-d149-4265-9373-eac133553fcd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:41.610845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 252/520] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 16 00:44:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:41.612713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0240ef-2cc6-4666-a72e-f64b01dd9508 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.613157 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0240ef-2cc6-4666-a72e-f64b01dd9508 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.613511 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0240ef-2cc6-4666-a72e-f64b01dd9508 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.615631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 253/521] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:41.617159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 269/522] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:41.621448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b1d4-9fbb-45f2-85ac-0c29e1ae5d6d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.621757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b1d4-9fbb-45f2-85ac-0c29e1ae5d6d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.622698 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b1d4-9fbb-45f2-85ac-0c29e1ae5d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.625523 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:41.644583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2c29b1d4-9fbb-45f2-85ac-0c29e1ae5d6d None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:41.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2c29b1d4-9fbb-45f2-85ac-0c29e1ae5d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:41.744631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 254/523] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:41.818188 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840bee5-179a-46e8-bc59-a0be08c40fec None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:41.901345 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:41.916797 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:41.917895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.918375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.918892 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.937696 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:41.939597 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:41.956578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:41.957549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:41.958511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:41.965212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 270/524] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:41.976910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29b1d4-9fbb-45f2-85ac-0c29e1ae5d6d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:41.998796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:42.124426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29b1d4-9fbb-45f2-85ac-0c29e1ae5d6d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:42.173847 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:42.174912 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.175402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.175880 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.176844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:42.177362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:42.179069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:42.195559 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:42.207138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 255/525] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:42.222435 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:42.351168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:42.395623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89610ff-0290-4188-b2b5-9dc481c50159 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:42.437986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:42.438562 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14ee8-7a48-4000-9542-a83c227126cc None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:42.439651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.440263 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.440794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/94c3191543bd4843be4f6db40a98122b/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.443099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=94c3191543bd4843be4f6db40a98122b, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:42.444999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:42.467364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 256/526] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:42 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/94c3191543bd4843be4f6db40a98122b/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:42.505628 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:42.506651 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.507213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.507765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] PATH_INFO: `/v3/services/network` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.508593 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:42.510278 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:42.527347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:42.529051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:42.530266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:42.533261 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 271/527] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:42 2022] GET /identity/v3/services/network => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:42.542494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:42.772909 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe183ba-14bb-47d2-b147-9008901e9373 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:42.812850 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:42.829290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13e6be-c952-4448-8f3c-e0de9ad37663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:42.830368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13e6be-c952-4448-8f3c-e0de9ad37663 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.830857 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13e6be-c952-4448-8f3c-e0de9ad37663 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.831338 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13e6be-c952-4448-8f3c-e0de9ad37663 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.832211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13e6be-c952-4448-8f3c-e0de9ad37663 None admin] RBAC: Adding query filter params (name=network) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:42.832749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13e6be-c952-4448-8f3c-e0de9ad37663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:42.834606 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13e6be-c952-4448-8f3c-e0de9ad37663 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:42.840627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 257/528] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:42.849070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:42.977968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:43.075668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11e55-403f-4aba-8e82-74c6765d7933 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:43.142795 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e03d02-3261-4705-8eee-e6f45d46d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:43.143843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03d02-3261-4705-8eee-e6f45d46d331 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:43.144276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03d02-3261-4705-8eee-e6f45d46d331 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:43.144805 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03d02-3261-4705-8eee-e6f45d46d331 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:43.145956 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e03d02-3261-4705-8eee-e6f45d46d331 None admin] RBAC: Adding query filter params (type=network) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:43.146500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e03d02-3261-4705-8eee-e6f45d46d331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:43.149145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e03d02-3261-4705-8eee-e6f45d46d331 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:43.162176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 272/529] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:44.296434 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2aac5-01fa-4491-ae65-1a98ad9ca0e7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:44.297455 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2aac5-01fa-4491-ae65-1a98ad9ca0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:44.297938 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2aac5-01fa-4491-ae65-1a98ad9ca0e7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:44.299935 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 258/530] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:44.307340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82997-b8e8-4f68-9087-2633b1cd777d None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:44.308277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82997-b8e8-4f68-9087-2633b1cd777d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:44.308854 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82997-b8e8-4f68-9087-2633b1cd777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:44.332339 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-54e82997-b8e8-4f68-9087-2633b1cd777d None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:44.333916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-54e82997-b8e8-4f68-9087-2633b1cd777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:44.426391 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 273/531] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:44.563427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2e91-dc17-4135-acef-cba4e0d613b7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:44.563921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2e91-dc17-4135-acef-cba4e0d613b7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:44.564475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2e91-dc17-4135-acef-cba4e0d613b7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:44.567513 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 259/532] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:44.576471 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60bfe-68c0-40e8-96d7-7bd6a8733b26 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:44.576984 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60bfe-68c0-40e8-96d7-7bd6a8733b26 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:44.577452 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60bfe-68c0-40e8-96d7-7bd6a8733b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:44.626271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-fdb60bfe-68c0-40e8-96d7-7bd6a8733b26 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:44.628349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-fdb60bfe-68c0-40e8-96d7-7bd6a8733b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:44.718543 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:44.772472 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 274/533] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:45.014997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c2e91-dc17-4135-acef-cba4e0d613b7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.249844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c2e91-dc17-4135-acef-cba4e0d613b7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.339078 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.340183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.341218 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.341867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.372630 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:45.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:45.382010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:45.382863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:45.388611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 260/534] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:45.390376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60bfe-68c0-40e8-96d7-7bd6a8733b26 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.425448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.530098 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:45.587272 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60bfe-68c0-40e8-96d7-7bd6a8733b26 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.634637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb01f3-bd5b-4419-8a37-1cb5c7e95802 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.641824 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1f17-733b-4e14-86ee-aad25d4b8421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.642927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1f17-733b-4e14-86ee-aad25d4b8421 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.643417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1f17-733b-4e14-86ee-aad25d4b8421 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.643894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1f17-733b-4e14-86ee-aad25d4b8421 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.644816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db1f17-733b-4e14-86ee-aad25d4b8421 None admin] RBAC: Adding query filter params (name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:45.645329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db1f17-733b-4e14-86ee-aad25d4b8421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:45.647052 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db1f17-733b-4e14-86ee-aad25d4b8421 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:45.660954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 275/535] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:45.663077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794ca1-b1b6-4caa-ae6e-09333d6a1b64 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.663583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794ca1-b1b6-4caa-ae6e-09333d6a1b64 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.664097 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794ca1-b1b6-4caa-ae6e-09333d6a1b64 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.672032 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 276/536] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:45.673314 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794ca1-b1b6-4caa-ae6e-09333d6a1b64 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.712468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c311-ab23-4f1e-9b2e-8e97064e7756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.713512 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c311-ab23-4f1e-9b2e-8e97064e7756 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.714001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c311-ab23-4f1e-9b2e-8e97064e7756 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.714519 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c311-ab23-4f1e-9b2e-8e97064e7756 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.738025 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:45.739000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94c311-ab23-4f1e-9b2e-8e97064e7756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9f94c311-ab23-4f1e-9b2e-8e97064e7756 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:45.750668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:45.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:45.752600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:45.760404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 261/537] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:45.764644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2ff9-5eb9-4fab-9472-b94a36476509 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.765254 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2ff9-5eb9-4fab-9472-b94a36476509 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.766230 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2ff9-5eb9-4fab-9472-b94a36476509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.801749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5e4c2ff9-5eb9-4fab-9472-b94a36476509 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:45.803871 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5e4c2ff9-5eb9-4fab-9472-b94a36476509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:45.833927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794ca1-b1b6-4caa-ae6e-09333d6a1b64 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.887104 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.888760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.889060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.889336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.901456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:45.902925 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:45.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:45.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:45.923297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:45.923297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:45.923297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:45.923297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 277/538] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:45.924162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.952345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 262/539] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:45.952345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8da14-eb90-4477-afbe-1fa5c7290003 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.952345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8da14-eb90-4477-afbe-1fa5c7290003 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.952345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8da14-eb90-4477-afbe-1fa5c7290003 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.952345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 263/540] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:45.952345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8da14-eb90-4477-afbe-1fa5c7290003 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.008287 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:46.071424 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:46.084682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6cc51-a1e6-4055-a89a-403abd9bb813 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.102891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8da14-eb90-4477-afbe-1fa5c7290003 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.140962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e312-6c09-41af-a085-bf1a5320419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.141498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e312-6c09-41af-a085-bf1a5320419c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.141775 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e312-6c09-41af-a085-bf1a5320419c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.142045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e312-6c09-41af-a085-bf1a5320419c None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.142729 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4e312-6c09-41af-a085-bf1a5320419c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:46.143035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4e312-6c09-41af-a085-bf1a5320419c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.144506 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4e312-6c09-41af-a085-bf1a5320419c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.153616 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.155307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.155860 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.156387 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.157335 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:46.157855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.159465 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 278/541] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:46.159848 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.160958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42af8-f024-473b-8d5a-1df5a31862e7 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.161249 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42af8-f024-473b-8d5a-1df5a31862e7 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.161528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42af8-f024-473b-8d5a-1df5a31862e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.177814 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 264/542] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:46.179231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.190336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b8d42af8-f024-473b-8d5a-1df5a31862e7 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:46.191541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b8d42af8-f024-473b-8d5a-1df5a31862e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:46.288453 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 279/543] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:46.289445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d42af8-f024-473b-8d5a-1df5a31862e7 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.333353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:46.339320 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69addf5-71d7-4777-aad1-8f316986fc1f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.387090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346b996-fa07-4b20-a8f4-36e1b3530873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.388521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b996-fa07-4b20-a8f4-36e1b3530873 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.389054 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b996-fa07-4b20-a8f4-36e1b3530873 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.389517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b996-fa07-4b20-a8f4-36e1b3530873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.406139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346b996-fa07-4b20-a8f4-36e1b3530873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.408650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346b996-fa07-4b20-a8f4-36e1b3530873 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6346b996-fa07-4b20-a8f4-36e1b3530873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:46.430426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:46.431459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:46.432388 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:46.432388 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:46.432388 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:46.434327 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 265/544] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:46.436288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d850f3-3996-45c8-a675-841236a19edc None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.436800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d850f3-3996-45c8-a675-841236a19edc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.437289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d850f3-3996-45c8-a675-841236a19edc None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.439923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 266/545] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:46.440983 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d850f3-3996-45c8-a675-841236a19edc None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.464234 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:46.487296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d42af8-f024-473b-8d5a-1df5a31862e7 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.548551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d039b-2b70-4855-a76b-3e6b70801f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.549675 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d039b-2b70-4855-a76b-3e6b70801f83 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.550203 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d039b-2b70-4855-a76b-3e6b70801f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.550713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d039b-2b70-4855-a76b-3e6b70801f83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.564296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d039b-2b70-4855-a76b-3e6b70801f83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.564688 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d850f3-3996-45c8-a675-841236a19edc None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.566726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d039b-2b70-4855-a76b-3e6b70801f83 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-7f9d039b-2b70-4855-a76b-3e6b70801f83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:46.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:46.590451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:46.592106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 280/546] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:46.593852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67854001-553e-4df0-97fc-dfedc2cb9682 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.594358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67854001-553e-4df0-97fc-dfedc2cb9682 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.594800 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67854001-553e-4df0-97fc-dfedc2cb9682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.604185 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.604832 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.605109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.605380 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.606036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:46.606375 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.607911 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.620418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 267/547] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:46.621249 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.623904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-67854001-553e-4df0-97fc-dfedc2cb9682 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:46.625265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-67854001-553e-4df0-97fc-dfedc2cb9682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:46.644239 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:46.703366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 281/548] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:46.703951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67854001-553e-4df0-97fc-dfedc2cb9682 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.756548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9100b2-4952-4261-a53e-c693232c2b62 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.799568 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.800246 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.800582 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.801754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.803595 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.827868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 268/549] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:46 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:46.828584 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.837303 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:46.884672 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67854001-553e-4df0-97fc-dfedc2cb9682 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.943204 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.944035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.944197 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.944611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.958679 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:46.964069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:46.966440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:46.969043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:46.971437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 282/550] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:46.972280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:47.010252 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:47.079381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348309ae-e806-4956-adf6-6ea56fd94d6b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.118308 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e1bc7-3cda-46eb-8520-c0f0d59445f1 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.140125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:47.141385 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.141995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.142558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.144293 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:47.144951 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:47.148712 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:47.162765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:47.170491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:47.171859 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.172438 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.174163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.183307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:47.187589 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:47.195600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 269/551] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:47.195600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:47.216466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:47.218252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:47.220181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 283/552] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:47.222704 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:47.332330 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a91ec-8cf0-45d2-b1ee-7ccd03801afc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.368946 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:47.377916 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:47.378541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.378820 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.379105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.380368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:47.380683 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:47.382142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:47.400587 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 270/553] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:47.400587 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:47.424389 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9000f-d6cc-4f1b-9829-83e86a9e2e63 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.491771 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:47.492779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.493259 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.493798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.495005 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:47.498220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:47.528377 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 284/554] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:47 2022] POST /identity/v3/services => generated 240 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:47.529620 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:47.542987 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1d0dd-12dc-4f3b-8e3c-0f1890e02ec5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.660010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:47.662030 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.662837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.664149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.688559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:47.692779 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:47.717644 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:47.731216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:47.732794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:47.733722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:47.733722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:47.733722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:47.736016 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 271/555] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:47.739403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa4524-9db9-47d5-b514-8370c7f36526 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.741249 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:47.808966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:47.810809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:47.812035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.812645 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.813300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.814343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:47.814832 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:47.817111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:47.842462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 285/556] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 16 00:44:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:47.843614 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:47.920134 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb30ad0-ecfe-4bbd-8f58-7a50c4d4cf91 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.991276 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:47.991629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee827-af84-447d-878c-aa642eac53e8 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:47.992628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.993216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.993791 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.018426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.020366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:48.041047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:48.042076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:48.043253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:48.043253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:48.043253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:48.043253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 272/557] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:48.044019 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.048150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.048820 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.049106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.049377 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.050022 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:48.050322 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.051697 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.065802 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 286/558] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:48.066825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.179207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.191316 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35a3d-6930-4e74-b8b1-11e1567fec5e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.220558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926158c0-2364-431b-bdf0-a13c12629e90 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.250210 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.251711 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.252799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.253633 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.265121 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.266566 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.266566 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.266566 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.267435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:48.267838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.269551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.273094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.274917 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.284556 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 287/559] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:48.285755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:48.298366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:48.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:48.301491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:48.301491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:48.301491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:48.308990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 273/560] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:48.312684 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.341217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.452379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7123d22-3243-447d-85c2-9548094ac1f5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.500168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.501150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.501382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.501757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.507155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dce1f-c365-4482-b0c9-29bf9367717c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.510430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.512505 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:48.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:48.530366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:48.533198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:48.536457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 288/561] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:48.540971 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.569800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.570631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.570977 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.571361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.589681 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.592137 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:48.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:48.610127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 274/562] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:48.611310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.616446 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.729102 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.745507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e31ad-1244-4bf1-85be-56288666ca60 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.747457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0203-2258-406f-8ba5-2118be284351 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.797199 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.797872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.798200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.798470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.799229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:48.799821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.801858 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.810372 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.811935 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.812767 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.813562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.815219 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:48.823314 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.823570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 289/563] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:48.823570 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.823834 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.843267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 275/564] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:48.843958 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.917391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.966928 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eb869-28ee-48c5-9dfd-7426bdc74606 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.010770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.011432 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.011776 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.012052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.014621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05de73-9b15-4fd6-bb47-a870f3593391 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.025548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.027063 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:49.042943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:49.044855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:49.046752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:49.048913 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 276/565] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:49.050181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.088497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.090034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.091351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.092143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.093960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:49.094816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.097816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.135931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 290/566] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:49.138282 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.158599 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:49.183029 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab4a1a-2570-4dc9-8275-831a169b4124 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.214001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:49.229389 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.230070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.230357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.230614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/bd96097b685d4e329ec46d0cfa19bfe1/roles/06e0d6417d76496f94940bc5222eb2b9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.249503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=bd96097b685d4e329ec46d0cfa19bfe1, role_id=06e0d6417d76496f94940bc5222eb2b9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.251064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.271953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 277/567] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:49 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/bd96097b685d4e329ec46d0cfa19bfe1/roles/06e0d6417d76496f94940bc5222eb2b9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:49.271953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.315063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7938a-4234-40f9-956f-4c7a18d3bb17 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.379632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7964c-f8ad-4d3f-b1b3-88e4f18573a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.381563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7964c-f8ad-4d3f-b1b3-88e4f18573a2 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.381563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7964c-f8ad-4d3f-b1b3-88e4f18573a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.381563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7964c-f8ad-4d3f-b1b3-88e4f18573a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.381961 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7964c-f8ad-4d3f-b1b3-88e4f18573a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:49.382135 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7964c-f8ad-4d3f-b1b3-88e4f18573a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.383565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7964c-f8ad-4d3f-b1b3-88e4f18573a2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.408263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 291/568] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:49.408263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88541e2-0919-43f7-ae09-8c4a51ef831b None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.408263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88541e2-0919-43f7-ae09-8c4a51ef831b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.408263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88541e2-0919-43f7-ae09-8c4a51ef831b None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.411756 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 292/569] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:49.413505 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c34e5-8697-423e-a38e-3189c0254e4a None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.413861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c34e5-8697-423e-a38e-3189c0254e4a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.414097 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c34e5-8697-423e-a38e-3189c0254e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.440431 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-f57c34e5-8697-423e-a38e-3189c0254e4a None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:49.441270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-f57c34e5-8697-423e-a38e-3189c0254e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:49.472920 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37bfbd-e53e-4303-bba1-ed51526140cb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.535171 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:49.547863 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 293/570] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:49.549785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c34e5-8697-423e-a38e-3189c0254e4a None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.558690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.559590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.559871 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.560306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.624695 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:49.672922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.676635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.729687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c34e5-8697-423e-a38e-3189c0254e4a None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.801652 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.802349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.802627 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.802904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/ad81ce2fa0644dae929e51279b7f9b76/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.808698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=ad81ce2fa0644dae929e51279b7f9b76, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.810359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.847940 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 294/571] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:49 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/ad81ce2fa0644dae929e51279b7f9b76/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:49.882741 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 278/572] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:44:49.888601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.905141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.026037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:50.069821 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:50.101249 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c5a8-5403-4e51-97f0-118c94a643ef None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:50.108305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c500-671f-4534-83fb-fc232d8ddb98 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:50.154774 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf30cf-1278-4295-a354-5905ed4a4ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:50.155444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf30cf-1278-4295-a354-5905ed4a4ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.155725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf30cf-1278-4295-a354-5905ed4a4ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.155892 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68fba7-9018-4da9-955f-ff38262b990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:50.156006 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf30cf-1278-4295-a354-5905ed4a4ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.157337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68fba7-9018-4da9-955f-ff38262b990b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.157337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68fba7-9018-4da9-955f-ff38262b990b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.157337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68fba7-9018-4da9-955f-ff38262b990b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.157742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68fba7-9018-4da9-955f-ff38262b990b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:50.159211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68fba7-9018-4da9-955f-ff38262b990b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ad68fba7-9018-4da9-955f-ff38262b990b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:50.171856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:50.173032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:50.173903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:50.174640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf30cf-1278-4295-a354-5905ed4a4ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:50.175436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 279/573] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 16 00:44:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:50.175512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf30cf-1278-4295-a354-5905ed4a4ee5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:50.175581 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3613-6846-4f10-8fd8-5857034280fa None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.175581 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3613-6846-4f10-8fd8-5857034280fa None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.175728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3613-6846-4f10-8fd8-5857034280fa None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.182150 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 280/574] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:50.183526 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3613-6846-4f10-8fd8-5857034280fa None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-aabf30cf-1278-4295-a354-5905ed4a4ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:50.204862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:50.205891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:50.206767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:50.206767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:50.206767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:50.206767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 295/575] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:50.207708 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fc43-bcf1-40ca-8096-369ebc61fc1e None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.207994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fc43-bcf1-40ca-8096-369ebc61fc1e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.208274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fc43-bcf1-40ca-8096-369ebc61fc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.242747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-2401fc43-bcf1-40ca-8096-369ebc61fc1e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:50.244027 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-2401fc43-bcf1-40ca-8096-369ebc61fc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:50.327508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3613-6846-4f10-8fd8-5857034280fa None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:50.349607 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 296/576] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:50.357007 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401fc43-bcf1-40ca-8096-369ebc61fc1e None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.383603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:50.384570 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.385391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.385814 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.389306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:50.389840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:50.392363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:50.409971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 281/577] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 16 00:44:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:50.412060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.416648 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:50.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:50.533482 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401fc43-bcf1-40ca-8096-369ebc61fc1e None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:50.576524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:50.577160 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.577419 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.577750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.578640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:50.578958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:50.581453 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:50.596252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 297/578] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:50.603635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.672905 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241747d-278a-48f0-aebd-4a6905801062 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:50.732248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:50.736287 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbbd3-985a-4fdc-97a6-85c443fb3f2d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:50.738819 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:50.740607 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.740840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.741125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.741799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:50.742104 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:50.743509 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:50.750562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 282/579] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 16 00:44:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:50.751578 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.781932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:50.783026 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.783540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.784080 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.792629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:50.794691 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:50.809789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:50.810780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:50.811948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:50.814631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 298/580] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:50.815787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.831891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:50.875232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4030f-c8d4-48a1-af7a-4d7cceddea0d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:50.914304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:50.914950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:50.915219 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:50.915492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] PATH_INFO: `/v3/services/network` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:50.916082 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:50.917577 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:50.927752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:50.930106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:50.931900 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 283/581] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:50 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:50.939664 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:50.987243 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e555ec-8c19-474d-a5cc-30b5369ea7c0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.057805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059305a-4fb9-4654-a856-75d5844ab111 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.058600 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.060379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.061379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.063255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.064792 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] RBAC: Adding query filter params (interface=public, service_id=6411b89b903141ebb1616acb82611ce9, region_id=RegionOne) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:51.065499 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.069188 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.092000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 299/582] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:44:50 2022] GET /identity/v3/endpoints?service_id=6411b89b903141ebb1616acb82611ce9&interface=public®ion_id=RegionOne => generated 194 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.094056 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:51.097914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:51.107640 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.108663 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.109090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.109521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.110376 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:51.110891 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.112649 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.132482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 284/583] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.133668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:51.148825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:51.259721 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d3141-f7e4-43df-8cb7-90945f6d58f6 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.299239 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6245d95-a8de-4419-bff2-f0cfefd20b0e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.304216 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.305171 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.305628 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.306104 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.306912 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:51.307907 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.310809 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.317876 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 300/584] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.319383 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:51.342714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.343306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.343603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.344407 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.345104 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.346870 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.356447 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 285/585] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:44:51 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.358426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:51.500612 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:51.509465 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:51.524988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbcca-0636-452e-94a9-f41e717edff0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.570143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.570786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.571068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.571339 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.572092 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=94c3191543bd4843be4f6db40a98122b) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:51.572437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.573965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.597086 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e6efb-c784-4d81-82a0-a9a5abe77419 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.600015 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 301/586] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:51 2022] GET /identity/v3/role_assignments?user.id=94c3191543bd4843be4f6db40a98122b&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.643129 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.643776 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.644121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.644431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.645098 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] RBAC: Adding query filter params (type=network) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:51.645449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.646899 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.653856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 286/587] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.659416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:51.787878 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde66ae-2019-482e-b037-f1fa8e3d4c5e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.831019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec1a0a-79dd-438e-97b4-0973bd10f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.831735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec1a0a-79dd-438e-97b4-0973bd10f524 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.832023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec1a0a-79dd-438e-97b4-0973bd10f524 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.832297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec1a0a-79dd-438e-97b4-0973bd10f524 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.833115 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec1a0a-79dd-438e-97b4-0973bd10f524 None admin] RBAC: Adding query filter params (interface=public, service_id=4361c98a91764683bee39a5ec64a7742, region_id=RegionOne) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:51.833428 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec1a0a-79dd-438e-97b4-0973bd10f524 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.835166 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec1a0a-79dd-438e-97b4-0973bd10f524 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.842145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 302/588] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:44:51 2022] GET /identity/v3/endpoints?service_id=4361c98a91764683bee39a5ec64a7742&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.847897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:51.979716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5e50-ad46-4730-90d4-1678feb114cb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:52.001410 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:52.024569 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efd258-b84d-4add-9f77-7fe194c0be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:52.025204 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd258-b84d-4add-9f77-7fe194c0be2d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.025490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd258-b84d-4add-9f77-7fe194c0be2d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.025766 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd258-b84d-4add-9f77-7fe194c0be2d None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.026392 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efd258-b84d-4add-9f77-7fe194c0be2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:52.027849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efd258-b84d-4add-9f77-7fe194c0be2d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:52.039326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 287/589] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:44:51 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:52.594707 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651868-d093-4232-81d0-edbccae5a10d None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.595119 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651868-d093-4232-81d0-edbccae5a10d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.595301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651868-d093-4232-81d0-edbccae5a10d None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.596971 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 303/590] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:52.615551 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa70a1-bc96-4997-8d35-937f52855775 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.615551 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa70a1-bc96-4997-8d35-937f52855775 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.615551 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa70a1-bc96-4997-8d35-937f52855775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.617443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7065d33-27f1-4dfe-857d-f3863124ceb0 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.617981 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7065d33-27f1-4dfe-857d-f3863124ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.617981 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7065d33-27f1-4dfe-857d-f3863124ceb0 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.619822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 304/591] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:52.625975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17723f93-1f07-48bb-9446-cc911ce985c7 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.626328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17723f93-1f07-48bb-9446-cc911ce985c7 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.626531 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17723f93-1f07-48bb-9446-cc911ce985c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.650045 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0afa70a1-bc96-4997-8d35-937f52855775 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:52.651260 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0afa70a1-bc96-4997-8d35-937f52855775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:52.663102 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-17723f93-1f07-48bb-9446-cc911ce985c7 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:52.664302 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-17723f93-1f07-48bb-9446-cc911ce985c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:52.681010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:52.765288 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 305/592] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:52.792673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 288/593] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:53.137321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17723f93-1f07-48bb-9446-cc911ce985c7 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.227281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa70a1-bc96-4997-8d35-937f52855775 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.303485 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17723f93-1f07-48bb-9446-cc911ce985c7 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.371801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.372544 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.372816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.373083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.396295 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:53.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:53.405099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:53.406429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 306/594] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:53.417397 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.422718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa70a1-bc96-4997-8d35-937f52855775 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.439253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.447596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.497176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.497833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.498111 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.498382 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.517112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:53.524644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:53.525661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:44:53.526514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:53.527762 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 289/595] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:53.534728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.628065 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23f062-39cb-4832-becb-3eb247babb97 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.668661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316759-a417-4f8f-8f3d-170f0ab2e7be None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.705513 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.706484 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.706985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.707454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.708359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:53.708898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.710770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.713118 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.714131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.714131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.714442 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.715119 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:53.716103 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.718006 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.727619 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 290/596] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:53.729388 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.738862 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 307/597] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:53.744621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.772711 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.850789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5518e2-5453-4220-a86c-4b6b5b54ffaa None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.866841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.893322 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.894354 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.894875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.895346 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.907382 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.909285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.909398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167426-f62f-4362-8d76-08c6ecd2ca5e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:53.926547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:53.928362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:53.930161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:53.930161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:53.930161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:53.939383 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 291/598] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:53.943596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.966349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.967352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.967820 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.968285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.987913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.990719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:54.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:54.021567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:54.024137 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:54.024137 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:54.024137 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:54.024137 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 308/599] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:54.031396 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.120288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.144874 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0db473-bad9-44df-8954-d523ed6d0181 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.221594 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfb9df-5a40-4e6d-801c-c3c7637ddae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.222540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb9df-5a40-4e6d-801c-c3c7637ddae8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.222954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb9df-5a40-4e6d-801c-c3c7637ddae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.223429 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb9df-5a40-4e6d-801c-c3c7637ddae8 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.224533 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfb9df-5a40-4e6d-801c-c3c7637ddae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:54.225057 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfb9df-5a40-4e6d-801c-c3c7637ddae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.230786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfb9df-5a40-4e6d-801c-c3c7637ddae8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.265600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 292/600] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:54.267238 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b301a-1e70-4861-9311-c6ca231d6060 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.267731 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b301a-1e70-4861-9311-c6ca231d6060 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.268238 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b301a-1e70-4861-9311-c6ca231d6060 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.274098 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 293/601] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:54.275875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da889a-dfe3-4b33-9d52-ec748b404474 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.276557 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da889a-dfe3-4b33-9d52-ec748b404474 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.277058 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da889a-dfe3-4b33-9d52-ec748b404474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.292608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7773-aeb1-44f1-ae55-a861d7551cbf None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.298559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-57da889a-dfe3-4b33-9d52-ec748b404474 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:54.300084 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-57da889a-dfe3-4b33-9d52-ec748b404474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:54.327962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.347786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.348875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.349394 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.350046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.351042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:54.351554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.353229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.368236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 309/602] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:54.369596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.400565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 294/603] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:54.401536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da889a-dfe3-4b33-9d52-ec748b404474 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.489415 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.515927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da889a-dfe3-4b33-9d52-ec748b404474 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.587120 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.587777 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.588056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.588345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.606128 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.608994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.625741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52696d11-b480-4d92-a91f-3737ec102844 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:54.650922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:54.651959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:44:54.653669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:54.664071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.664747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.665240 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.665415 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 295/604] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:54.665591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.673584 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.674395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.675016 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:54.688053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:54.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:44:54.692668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:54.700391 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 310/605] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:54.700391 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.747487 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.858323 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55676b8b-aff6-4837-8cad-a25b5ce5bccd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.909838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5bac5-9922-4d2a-890d-ff0a62930fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.910303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b0ee-c53a-49ad-a07f-729ee6bf12d5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.910484 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bac5-9922-4d2a-890d-ff0a62930fbe None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.910721 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bac5-9922-4d2a-890d-ff0a62930fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.910999 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bac5-9922-4d2a-890d-ff0a62930fbe None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.911737 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bac5-9922-4d2a-890d-ff0a62930fbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:54.912045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bac5-9922-4d2a-890d-ff0a62930fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.914823 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bac5-9922-4d2a-890d-ff0a62930fbe None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.944420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 311/606] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:54.947060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8921b0d-467f-4063-b852-aebf74172523 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.947347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8921b0d-467f-4063-b852-aebf74172523 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.947625 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8921b0d-467f-4063-b852-aebf74172523 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.949244 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 312/607] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:54.953656 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8921b0d-467f-4063-b852-aebf74172523 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.958500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcc60d-37ad-4a57-a26e-dfecae2154b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.959121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc60d-37ad-4a57-a26e-dfecae2154b5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.959645 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc60d-37ad-4a57-a26e-dfecae2154b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.959929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc60d-37ad-4a57-a26e-dfecae2154b5 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.960703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcc60d-37ad-4a57-a26e-dfecae2154b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:54.961010 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcc60d-37ad-4a57-a26e-dfecae2154b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.962585 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcc60d-37ad-4a57-a26e-dfecae2154b5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.965678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.986650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 296/608] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:54.988098 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47b665-864b-4b29-9528-455fb690d1a5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.988442 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47b665-864b-4b29-9528-455fb690d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.988717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47b665-864b-4b29-9528-455fb690d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.014173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6f47b665-864b-4b29-9528-455fb690d1a5 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:55.015399 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6f47b665-864b-4b29-9528-455fb690d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:55.093649 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 297/609] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:55.094898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47b665-864b-4b29-9528-455fb690d1a5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:55.110674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:55.117072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8921b0d-467f-4063-b852-aebf74172523 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:55.170401 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:55.171200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:55.171577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:55.171946 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.242310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47b665-864b-4b29-9528-455fb690d1a5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:55.276953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:55.280541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:55.283595 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:55.293088 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7267-6cb2-457c-b244-9d3abed5e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:55.294267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7267-6cb2-457c-b244-9d3abed5e30e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:55.294878 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7267-6cb2-457c-b244-9d3abed5e30e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:55.295334 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7267-6cb2-457c-b244-9d3abed5e30e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.382810 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7267-6cb2-457c-b244-9d3abed5e30e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:55.385575 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7267-6cb2-457c-b244-9d3abed5e30e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:55.413837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:55.425630 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 313/610] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:44:55.427127 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:55.538327 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f891169-901f-4069-a0a9-c42be8866968 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:55.566843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 298/611] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:44:55.566843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ac1a-c854-4f71-8014-81cc14c5526c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:55.566843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ac1a-c854-4f71-8014-81cc14c5526c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:55.566843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ac1a-c854-4f71-8014-81cc14c5526c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.573095 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 299/612] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:55.574007 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ac1a-c854-4f71-8014-81cc14c5526c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:55.583165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:55.584142 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:55.584885 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:55.585311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.586076 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:55.587687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:55.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:55.599716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:44:55.600813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:55.603038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 314/613] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 16 00:44:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:55.604093 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:55.621174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:55.676055 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:55.705862 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ac1a-c854-4f71-8014-81cc14c5526c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:55.719360 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef752e-e401-4a0e-9326-3afe4dd66088 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:55.744849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd071ff4-9f90-43f9-85a4-2b2acb8fe4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:55.745490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd071ff4-9f90-43f9-85a4-2b2acb8fe4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:55.745769 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd071ff4-9f90-43f9-85a4-2b2acb8fe4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:55.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd071ff4-9f90-43f9-85a4-2b2acb8fe4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.756803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd071ff4-9f90-43f9-85a4-2b2acb8fe4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:55.757993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:55.758274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd071ff4-9f90-43f9-85a4-2b2acb8fe4a1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:55.758736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:55.759074 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:55.759404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.773128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:55.774704 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fd071ff4-9f90-43f9-85a4-2b2acb8fe4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:55.775050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:55.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:55.776887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:55.776887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:55.776887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:55.776887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 300/614] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:55.777474 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1550a-735f-4d7c-97f2-7b1f19faf0e0 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:55.778386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1550a-735f-4d7c-97f2-7b1f19faf0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:55.778670 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1550a-735f-4d7c-97f2-7b1f19faf0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:55.793528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:55.795417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:55.797929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:55.797929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:55.797929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:55.797929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 315/615] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:55.797929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:55.798496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bec1550a-735f-4d7c-97f2-7b1f19faf0e0 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:55.798956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bec1550a-735f-4d7c-97f2-7b1f19faf0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:55.893899 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 301/616] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:55.894763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1550a-735f-4d7c-97f2-7b1f19faf0e0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:55.905203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:55.934998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7c5d-425f-41ac-a294-5c20669396fe None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:55.965830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.006833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad11763-351d-4954-8c18-309159372463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.008047 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11763-351d-4954-8c18-309159372463 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.008623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11763-351d-4954-8c18-309159372463 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.009220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11763-351d-4954-8c18-309159372463 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.010426 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad11763-351d-4954-8c18-309159372463 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:56.010963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad11763-351d-4954-8c18-309159372463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.014290 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad11763-351d-4954-8c18-309159372463 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.028823 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 316/617] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 16 00:44:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:56.030243 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad11763-351d-4954-8c18-309159372463 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.082803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1550a-735f-4d7c-97f2-7b1f19faf0e0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.131398 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.132061 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.132438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.132642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.133254 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.134740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:56.145532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:56.147384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:56.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 302/618] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 16 00:44:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:56.152400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.207358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad11763-351d-4954-8c18-309159372463 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.265223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.266463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.267365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.268051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.269185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:56.269701 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.271961 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.278036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.295468 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 317/619] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:56.295468 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.330675 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fdc8e-57bc-4856-a310-ec715304274c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.352746 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.376531 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.377503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.377958 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.378413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.379513 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:56.380022 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.382450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.401923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 303/620] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:56.403558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0d39-d3f3-4131-b35a-7476e05c09ab None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.476233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.476875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.477163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.477441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.478083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:56.478391 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.479800 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.485572 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 318/621] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:56.486425 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.535019 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043feffe-c498-467c-ab59-4497540016f0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.567644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.575224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.575924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.576208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.576564 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.577245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:56.577556 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.578968 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.583937 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 304/622] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:56.585054 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.635552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57578-e37f-403b-a105-e9aa0b71e79b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.637565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.678845 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.679741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.679741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.680000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] PATH_INFO: `/v3/services/network` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.680613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.682004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:56.691705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:56.693638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:56.695263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 319/623] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:56.696900 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.719735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cabcc-dad4-46dd-8960-cc932e7cecec None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.761011 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.761671 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.761948 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.762447 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.770305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.771841 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:56.785423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:56.786764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 305/624] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:56.789015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.837816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a16c4-1415-48f4-b45e-50e3028f7b69 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.866739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.899623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.900666 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.901154 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.901648 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.915989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.919408 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:56.928532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81353-8956-42de-ae30-34f33df0c4c4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:56.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:56.944693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:44:56.946146 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 320/625] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:56.948022 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:56.976726 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:56.977404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.977686 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.977980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.978729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:56.980237 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.000128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.026418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 306/626] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:57.026418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.141212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a467-e860-421a-8b3d-1398e70af1e9 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.211876 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.213012 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.213454 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.213755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.214375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:57.214682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.215945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3457-19b8-4716-9bc3-83e2a5699920 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.216560 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.222378 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 321/627] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.223262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.227059 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.287633 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.289253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.289834 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.290165 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.290925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] RBAC: Adding query filter params (name=network) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:57.291303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.292876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.301409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 307/628] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.304650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.367294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.392433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53dbc0-5603-4573-b70d-ab0214772589 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.453614 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.454357 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.454708 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.454989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.455819 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:57.456089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.457603 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.473381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 322/629] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.474172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.540502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f2a8-160d-4050-9934-3f6e783bf276 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.583538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.584209 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.584820 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.585102 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.586115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:57.586431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.588952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.608567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 308/630] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.610146 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.651864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.654287 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0ecc-aba6-40ce-9c9b-f66be67d54e8 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.721109 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.722114 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.722607 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.723072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.724456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:57.724947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.727660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.743926 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dffe-de33-4c54-b316-99c20ef16cfa None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.744834 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 323/631] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.747019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.772559 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.792186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.792851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.793132 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.793941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.794899 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] RBAC: Adding query filter params (role.id=06e0d6417d76496f94940bc5222eb2b9, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=bd96097b685d4e329ec46d0cfa19bfe1) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:57.795756 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.796826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.804444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 309/632] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/role_assignments?user.id=bd96097b685d4e329ec46d0cfa19bfe1&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=06e0d6417d76496f94940bc5222eb2b9 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.805436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.923353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.936594 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb628-a473-4219-acc4-f980cc9fe010 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.945477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5c02-9438-48d7-9a92-c399e8f5e4d6 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.985947 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3e6e-20f0-446d-b3c6-2394faa64392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.987801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3e6e-20f0-446d-b3c6-2394faa64392 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.988259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3e6e-20f0-446d-b3c6-2394faa64392 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.988738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3e6e-20f0-446d-b3c6-2394faa64392 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.990048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3e6e-20f0-446d-b3c6-2394faa64392 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.991746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3e6e-20f0-446d-b3c6-2394faa64392 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:58.014102 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fedde-bee5-4886-8356-7879fb099130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:58.015674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fedde-bee5-4886-8356-7879fb099130 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:58.016352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fedde-bee5-4886-8356-7879fb099130 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:58.016773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fedde-bee5-4886-8356-7879fb099130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:58.018581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fedde-bee5-4886-8356-7879fb099130 None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=ad81ce2fa0644dae929e51279b7f9b76) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:58.019374 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fedde-bee5-4886-8356-7879fb099130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:58.022968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fedde-bee5-4886-8356-7879fb099130 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:58.032155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 310/633] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:58.041924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 324/634] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/role_assignments?user.id=ad81ce2fa0644dae929e51279b7f9b76&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:59.478733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2f490-e507-4a69-9df3-7874f818fcfb None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.479741 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2f490-e507-4a69-9df3-7874f818fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.480253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2f490-e507-4a69-9df3-7874f818fcfb None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.482884 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 311/635] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:59.489199 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4f452-947b-41e4-a877-e16c9719868e None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.490154 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4f452-947b-41e4-a877-e16c9719868e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.490646 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4f452-947b-41e4-a877-e16c9719868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.510975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-18c4f452-947b-41e4-a877-e16c9719868e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:59.513070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-18c4f452-947b-41e4-a877-e16c9719868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:59.634438 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:59.660761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 325/636] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:59.947292 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5b460-533b-4b11-9622-b13a8887abfe None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.947634 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5b460-533b-4b11-9622-b13a8887abfe None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.947973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5b460-533b-4b11-9622-b13a8887abfe None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.949863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 312/637] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:59.956371 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6c48-6c63-486a-ac69-c5faec8fdd09 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.956656 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6c48-6c63-486a-ac69-c5faec8fdd09 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.956975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6c48-6c63-486a-ac69-c5faec8fdd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.979538 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-1cfd6c48-6c63-486a-ac69-c5faec8fdd09 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:59.981504 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1cfd6c48-6c63-486a-ac69-c5faec8fdd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:00.070437 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5b460-533b-4b11-9622-b13a8887abfe None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.099019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 326/638] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:00.263917 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5b460-533b-4b11-9622-b13a8887abfe None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.329901 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.330947 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.331418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.331890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.332907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.335591 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:00.353424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:00.355406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:00.356923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 313/639] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:00.366164 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6c48-6c63-486a-ac69-c5faec8fdd09 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.554159 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.566948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6c48-6c63-486a-ac69-c5faec8fdd09 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.589851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:00.645976 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:00.658048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.659452 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.660009 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.660596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:00.662377 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.665067 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.674588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 327/640] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:00.685297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.788205 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2dd6-3138-435e-b693-758a30e663ab None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.864971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3e68-2948-4309-880a-27e37abc957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.866143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3e68-2948-4309-880a-27e37abc957c None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.866763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3e68-2948-4309-880a-27e37abc957c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.867382 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3e68-2948-4309-880a-27e37abc957c None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.868749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee3e68-2948-4309-880a-27e37abc957c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.871945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee3e68-2948-4309-880a-27e37abc957c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.900399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f6fc5-aa20-4012-8831-26a53a18580d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.905331 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 314/641] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:00 2022] POST /identity/v3/services => generated 269 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:00.985426 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa43db-549b-462e-b629-58e42c4d9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.986433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa43db-549b-462e-b629-58e42c4d9e4a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa43db-549b-462e-b629-58e42c4d9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.987473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa43db-549b-462e-b629-58e42c4d9e4a None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.988682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa43db-549b-462e-b629-58e42c4d9e4a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:00.989222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa43db-549b-462e-b629-58e42c4d9e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.991951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa43db-549b-462e-b629-58e42c4d9e4a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:01.002257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 328/642] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:01.226890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea89b-b201-4b9c-a8db-23eb2caf819c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:01.226890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea89b-b201-4b9c-a8db-23eb2caf819c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:01.226890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea89b-b201-4b9c-a8db-23eb2caf819c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:01.228117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 315/643] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:01.234899 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc118-c558-4dc4-8f6a-da597a160ecf None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:01.235564 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc118-c558-4dc4-8f6a-da597a160ecf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:01.236087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc118-c558-4dc4-8f6a-da597a160ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:01.257737 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-880bc118-c558-4dc4-8f6a-da597a160ecf None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:01.259363 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-880bc118-c558-4dc4-8f6a-da597a160ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:01.330484 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:01.358871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 329/644] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:01.633019 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea89b-b201-4b9c-a8db-23eb2caf819c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:01.778284 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:01.827800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea89b-b201-4b9c-a8db-23eb2caf819c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:01.861484 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e602-6512-4621-90a6-63e8cb3e05c8 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:01.862331 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e602-6512-4621-90a6-63e8cb3e05c8 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:01.862482 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e602-6512-4621-90a6-63e8cb3e05c8 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:01.871445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 330/645] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:01.873764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd5ec-65a2-422a-91e8-7db97557af0b None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:01.874250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd5ec-65a2-422a-91e8-7db97557af0b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:01.874728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd5ec-65a2-422a-91e8-7db97557af0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:01.895917 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:01.897591 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:01.898416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:01.898910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:01.907787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-5b1dd5ec-65a2-422a-91e8-7db97557af0b None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:01.910436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-5b1dd5ec-65a2-422a-91e8-7db97557af0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:01.921318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:01.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:01.928673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:01.930466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 316/646] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 16 00:45:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:01.934818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:02.012369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 331/647] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:02.085194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b9e64-222d-47eb-8165-498821675a15 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:02.123372 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:02.124004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:02.124287 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:02.124592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:02.125276 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:02.125580 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:02.127084 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:02.128862 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:02.139600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 317/648] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 16 00:45:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:02.145513 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dd5ec-65a2-422a-91e8-7db97557af0b None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:02.267990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dd5ec-65a2-422a-91e8-7db97557af0b None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:02.285101 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:02.308260 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:02.309219 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:02.309514 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:02.309792 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:02.321604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:02.323098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:02.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:02.343213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:02.345000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:02.345000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:02.345000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:02.347799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 332/649] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:02.349927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:02.531117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a1e2-c096-4abd-ab36-642c2e2e2f1c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:02.541914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:02.591529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:02.592588 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:02.593074 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:02.593558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:02.594678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:02.595191 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:02.597722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:02.617997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 318/650] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:02.625447 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:02.676626 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d354a-2ca2-47fc-a8f0-d0970bf995a0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:02.736647 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:02.747917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:02.749068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:02.749926 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:02.750501 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:02.751589 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:02.754847 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:02.768349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:02.770208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:02.771783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 333/651] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:02.781650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:02.829464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:02.862966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b20ff9-d2e7-480e-87ee-f5be27c312c0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:02.928133 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:02.929000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:02.929391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:02.929892 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:02.944925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:02.947814 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:02.956373 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef88d-df2b-4af9-9887-6b14298221cc None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:02.972152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:02.974348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:45:02.976618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:02.978973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 319/652] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:45:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:02.985627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.044407 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.046051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.046957 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.047727 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.049367 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:03.050551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:03.053922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:03.065189 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 334/653] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:03.073275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.113921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ca8a5-e97a-449d-8ca3-e4e523e458c6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:03.135852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:03.169057 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.170099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.170565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.171003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.172425 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:03.172974 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:03.175730 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:03.217896 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 320/654] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 16 00:45:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:03.231413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.324005 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:03.337500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704dc95-96ab-4b90-a03b-8a32f5fd835e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:03.406838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.408126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.408654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.409139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.410324 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:03.411271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:03.414074 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:03.422998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 335/655] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:03.460713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6cab0-c54f-41dc-a18f-410f515d81ba None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:03.528591 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0f739-de38-4d83-b789-925623654de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.530151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0f739-de38-4d83-b789-925623654de5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.530874 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0f739-de38-4d83-b789-925623654de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.531603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0f739-de38-4d83-b789-925623654de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.552898 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0f739-de38-4d83-b789-925623654de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:03.556098 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0f739-de38-4d83-b789-925623654de5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-cdd0f739-de38-4d83-b789-925623654de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:03.588631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:03.591311 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:03.593492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:03.593492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:03.593492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:03.596689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 321/656] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:03.606706 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.795635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b477ef-9b63-4888-9ae0-2274a0097819 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:03.837194 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.837888 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.838175 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.838453 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.839251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:03.839486 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:03.841143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:03.864866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 336/657] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:03.871580 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c297a3-a709-4acb-98fb-f3167dc8de13 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.872420 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c297a3-a709-4acb-98fb-f3167dc8de13 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.872420 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c297a3-a709-4acb-98fb-f3167dc8de13 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.873616 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 322/658] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:03.875315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.879398 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8d28-e03d-4c42-855e-b218524a7f40 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.879772 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8d28-e03d-4c42-855e-b218524a7f40 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.879944 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8d28-e03d-4c42-855e-b218524a7f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.903183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-439e8d28-e03d-4c42-855e-b218524a7f40 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:03.904494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-439e8d28-e03d-4c42-855e-b218524a7f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:03.912463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:03.942796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.040343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 323/659] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:03 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:04.040544 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe15b5-66b5-488f-8d40-c2eb1f4a1d58 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.063138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fbb85-4a4b-447b-a6a6-7395571d8722 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.063727 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fbb85-4a4b-447b-a6a6-7395571d8722 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.064218 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fbb85-4a4b-447b-a6a6-7395571d8722 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.066957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 324/660] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:04.073972 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5fcf-9f24-487e-95b4-d6619eaa9884 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.075021 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5fcf-9f24-487e-95b4-d6619eaa9884 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.079974 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5fcf-9f24-487e-95b4-d6619eaa9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.101161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04667e-59da-41be-9159-11976036b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.101755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04667e-59da-41be-9159-11976036b73c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.102213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04667e-59da-41be-9159-11976036b73c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.102629 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04667e-59da-41be-9159-11976036b73c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.108559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ecdb5fcf-9f24-487e-95b4-d6619eaa9884 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:04.110694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ecdb5fcf-9f24-487e-95b4-d6619eaa9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:04.111069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04667e-59da-41be-9159-11976036b73c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.112600 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04667e-59da-41be-9159-11976036b73c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-ab04667e-59da-41be-9159-11976036b73c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:04.127703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:04.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:04.129650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 337/661] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:04.139165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04667e-59da-41be-9159-11976036b73c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.241190 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 325/662] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:04 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:04.296779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.333559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5fcf-9f24-487e-95b4-d6619eaa9884 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.335000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04667e-59da-41be-9159-11976036b73c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.423177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.424530 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.426886 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.428212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:04.428779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.431330 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.445953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.468755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 338/663] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:04.470557 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.478573 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5fcf-9f24-487e-95b4-d6619eaa9884 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.562894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.563830 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.564361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.564870 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.565924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.568831 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:04.591114 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:04.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:45:04.595921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:04.600511 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 326/664] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:04.601515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.638151 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a631f3-284a-4a4c-a80f-cc18f8c02bb9 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.681210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.681782 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.682056 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.682328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/bd96097b685d4e329ec46d0cfa19bfe1/roles/5bb82326b88e4e608aa7a93aaf5626b5` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.684711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=bd96097b685d4e329ec46d0cfa19bfe1, role_id=5bb82326b88e4e608aa7a93aaf5626b5)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.686163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.697131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.716771 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 339/665] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:04 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/bd96097b685d4e329ec46d0cfa19bfe1/roles/5bb82326b88e4e608aa7a93aaf5626b5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:45:04.718507 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.814725 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeda38-0864-406a-bc79-6e797953f571 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.861099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.862273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.862768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.863288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.864391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.866140 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.892925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 327/666] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:04 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:04.920059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56d719-190f-4950-a034-8ddcfe9d69a7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.001682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.002240 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.002517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.002783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.003440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:05.003745 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.005207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.011383 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 340/667] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.020750 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.221116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5623a4-0437-42e0-a6f8-e9733f9c5c83 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.292450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.292450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.292450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.292450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.293614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:05.293614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.293614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.303153 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 328/668] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.313520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.419045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.477815 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033bc-f0f3-4dcf-b9d8-536c11432539 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.518258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae706c-b111-4a56-9726-15e5d7e16c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.518959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae706c-b111-4a56-9726-15e5d7e16c66 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.519255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae706c-b111-4a56-9726-15e5d7e16c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.519533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae706c-b111-4a56-9726-15e5d7e16c66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.520249 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae706c-b111-4a56-9726-15e5d7e16c66 None admin] RBAC: Adding query filter params (interface=public, service_id=4d2cdd0de0c24bf7acbea3966a0b3179, region_id=RegionOne) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:05.520650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae706c-b111-4a56-9726-15e5d7e16c66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.522035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae706c-b111-4a56-9726-15e5d7e16c66 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.528901 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 341/669] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/endpoints?service_id=4d2cdd0de0c24bf7acbea3966a0b3179&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.535026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.638271 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.666105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06344c46-9b40-425e-ae80-acf804103ab8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.703755 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2990c-3b08-4dc9-9a03-600087bb1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.704431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2990c-3b08-4dc9-9a03-600087bb1423 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.704722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2990c-3b08-4dc9-9a03-600087bb1423 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.704996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2990c-3b08-4dc9-9a03-600087bb1423 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.705655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2990c-3b08-4dc9-9a03-600087bb1423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.707143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2990c-3b08-4dc9-9a03-600087bb1423 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.714603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 329/670] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:45:06.007132 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6388a-1d91-4dd6-9f16-a7215db721a2 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.007384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6388a-1d91-4dd6-9f16-a7215db721a2 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.007693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6388a-1d91-4dd6-9f16-a7215db721a2 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.009615 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 342/671] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:06.016234 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544953db-bb32-4ed0-bff4-33d3656badfb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.016803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544953db-bb32-4ed0-bff4-33d3656badfb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.016803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544953db-bb32-4ed0-bff4-33d3656badfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.039471 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-544953db-bb32-4ed0-bff4-33d3656badfb None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:06.040734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-544953db-bb32-4ed0-bff4-33d3656badfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:06.155859 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 330/672] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:06.433724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6388a-1d91-4dd6-9f16-a7215db721a2 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:06.557718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6388a-1d91-4dd6-9f16-a7215db721a2 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:06.586952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:06.598800 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e23771-1a13-43ba-8f95-78531121df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:06.599479 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e23771-1a13-43ba-8f95-78531121df17 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.599765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e23771-1a13-43ba-8f95-78531121df17 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.600040 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e23771-1a13-43ba-8f95-78531121df17 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.600769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e23771-1a13-43ba-8f95-78531121df17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:06.602162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e23771-1a13-43ba-8f95-78531121df17 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:06.628577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 343/673] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:06 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:08.061000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c830c-cf24-44eb-97e7-46a88c290ef5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.061536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c830c-cf24-44eb-97e7-46a88c290ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.061536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c830c-cf24-44eb-97e7-46a88c290ef5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.063148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 331/674] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:08.068871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe97ef-4266-48a7-8a6a-41244ca3e118 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.069794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe97ef-4266-48a7-8a6a-41244ca3e118 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.070295 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe97ef-4266-48a7-8a6a-41244ca3e118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.092105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-ebfe97ef-4266-48a7-8a6a-41244ca3e118 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:08.093701 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-ebfe97ef-4266-48a7-8a6a-41244ca3e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:08.116096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0659f4-fcb4-4e9f-9130-7e430bc04e53 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.116753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0659f4-fcb4-4e9f-9130-7e430bc04e53 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.117272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0659f4-fcb4-4e9f-9130-7e430bc04e53 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.119050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 332/675] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:08.124507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3ee4-52ad-407a-ba1e-a00749a44b6f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.125083 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3ee4-52ad-407a-ba1e-a00749a44b6f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.125585 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3ee4-52ad-407a-ba1e-a00749a44b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.145107 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-826e3ee4-52ad-407a-ba1e-a00749a44b6f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:08.146655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-826e3ee4-52ad-407a-ba1e-a00749a44b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:08.188589 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 344/676] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:08.232350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:08.235757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 333/677] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:08.478709 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe97ef-4266-48a7-8a6a-41244ca3e118 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:08.511060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3ee4-52ad-407a-ba1e-a00749a44b6f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:08.593154 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe97ef-4266-48a7-8a6a-41244ca3e118 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:08.605338 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:08.640046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8d08-5ad4-4bdd-9b33-deab36071169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:08.641155 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8d08-5ad4-4bdd-9b33-deab36071169 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.641666 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8d08-5ad4-4bdd-9b33-deab36071169 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.642170 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8d08-5ad4-4bdd-9b33-deab36071169 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.643269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8d08-5ad4-4bdd-9b33-deab36071169 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:08.645939 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8d08-5ad4-4bdd-9b33-deab36071169 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:08.646366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3ee4-52ad-407a-ba1e-a00749a44b6f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-02de8d08-5ad4-4bdd-9b33-deab36071169 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:08.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:08.665930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:08.666954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:08.667721 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 345/678] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:08.669364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d26a-dd47-41e3-9b4b-75bb287579e5 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.669863 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d26a-dd47-41e3-9b4b-75bb287579e5 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.670679 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d26a-dd47-41e3-9b4b-75bb287579e5 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.680018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 346/679] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:08.680018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d26a-dd47-41e3-9b4b-75bb287579e5 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:08.693186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c017-89cd-46aa-8abe-fdec2b2bed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:08.693831 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c017-89cd-46aa-8abe-fdec2b2bed95 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.694112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c017-89cd-46aa-8abe-fdec2b2bed95 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.694392 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c017-89cd-46aa-8abe-fdec2b2bed95 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.694988 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c017-89cd-46aa-8abe-fdec2b2bed95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:08.696599 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c017-89cd-46aa-8abe-fdec2b2bed95 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0c55c017-89cd-46aa-8abe-fdec2b2bed95 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:08.707827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:08.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:45:08.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:08.713012 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 334/680] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 16 00:45:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:08.714458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0d3d0-b144-4e58-a197-bddbdd69d9f9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.714826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0d3d0-b144-4e58-a197-bddbdd69d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.715289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0d3d0-b144-4e58-a197-bddbdd69d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.734410 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-84c0d3d0-b144-4e58-a197-bddbdd69d9f9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:08.735745 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-84c0d3d0-b144-4e58-a197-bddbdd69d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:08.805333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:08.825037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 335/681] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:08.825037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0d3d0-b144-4e58-a197-bddbdd69d9f9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:08.873874 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d26a-dd47-41e3-9b4b-75bb287579e5 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:08.917643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd19ab-3d26-4371-9bef-1a62d1208d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:08.919001 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd19ab-3d26-4371-9bef-1a62d1208d82 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.919423 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd19ab-3d26-4371-9bef-1a62d1208d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.919725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd19ab-3d26-4371-9bef-1a62d1208d82 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.920407 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd19ab-3d26-4371-9bef-1a62d1208d82 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:08.920725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd19ab-3d26-4371-9bef-1a62d1208d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:08.922090 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd19ab-3d26-4371-9bef-1a62d1208d82 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:08.933059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 347/682] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:08.933059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91406-444f-4f2c-bd3e-730492111d60 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.933059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91406-444f-4f2c-bd3e-730492111d60 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.933059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91406-444f-4f2c-bd3e-730492111d60 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.933059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 348/683] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:08.939824 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91406-444f-4f2c-bd3e-730492111d60 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.005525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.021465 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0d3d0-b144-4e58-a197-bddbdd69d9f9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.080632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634f069-6afa-47c1-a3df-527fd16969f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.081475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f069-6afa-47c1-a3df-527fd16969f1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.081616 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f069-6afa-47c1-a3df-527fd16969f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.081753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f069-6afa-47c1-a3df-527fd16969f1 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.082406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f069-6afa-47c1-a3df-527fd16969f1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:09.082709 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f069-6afa-47c1-a3df-527fd16969f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.084110 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f069-6afa-47c1-a3df-527fd16969f1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.090831 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 336/684] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:09.092177 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55433cf4-8a01-49aa-b72a-dd4e3a34a9f3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.092532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55433cf4-8a01-49aa-b72a-dd4e3a34a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.092786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55433cf4-8a01-49aa-b72a-dd4e3a34a9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.113388 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-55433cf4-8a01-49aa-b72a-dd4e3a34a9f3 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:09.114628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-55433cf4-8a01-49aa-b72a-dd4e3a34a9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:09.133301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91406-444f-4f2c-bd3e-730492111d60 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.172689 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.187723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.188829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.189332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.189846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.190510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 337/685] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:09.190998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:09.191373 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55433cf4-8a01-49aa-b72a-dd4e3a34a9f3 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.191563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.195616 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.205373 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 349/686] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:09.206254 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.327482 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.331798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8d4bc-1e1b-4856-ab0b-e7cf9a07f490 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.342546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55433cf4-8a01-49aa-b72a-dd4e3a34a9f3 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.382032 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.383323 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.384222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.392383 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.393015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.393297 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.393578 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.394235 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:09.394545 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.395956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.399128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:09.402008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 338/687] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:09.403300 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:09.406316 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:09.407321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:09.408187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 350/688] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:09.410408 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.466465 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.526412 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e046429-b9e8-4951-b330-a5cf17e07914 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.529667 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3057-18d0-4d91-8855-e210c7fe70bd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.566320 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.566993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.567287 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.567406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.567562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.567665 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.567877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.568337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] RBAC: Adding query filter params (interface=public, service_id=2b302afec1024410867351467b27a414, region_id=RegionOne) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:09.568592 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.568686 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.569973 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.570082 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.585358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 339/689] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/endpoints?service_id=2b302afec1024410867351467b27a414&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:09.585358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.598368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 351/690] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:45:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:09.599123 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.626643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.772612 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7db7de-a10e-499a-b06f-bf8301bb3fd0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.782104 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e0ef5-946c-4e90-b8a9-be227dfa3218 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.792600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.820385 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.820947 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.821229 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.821505 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.822179 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:09.823048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.824622 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.836215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 340/691] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:09.837025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.849220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.850312 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.850803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.851299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.852447 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.855098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.873176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 352/692] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/services => generated 1497 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:45:09.873176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.985325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ff5f1-5977-4f5a-afd8-49453f32baa9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.035829 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.036533 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.036818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.037096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.037696 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.039906 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:10.050866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:10.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:10.057305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 341/693] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:10.062529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.068759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.103165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aae76-cfb2-4064-9098-deeb6a8e9529 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.149037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.150026 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.150026 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.150279 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.155965 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.164467 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.166167 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:10.185265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:10.187386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:10.189923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:10.189923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:10.189923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:10.189923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 353/694] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:10.193573 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.287797 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb677d-9540-4627-85fa-37e9e2385dce None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.361419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.362587 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.363257 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.363976 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.365570 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:10.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.369099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.384737 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 342/695] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:10.388761 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.408648 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cd6b-33e2-45b3-a386-752f67e92c78 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.468376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.488172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.488856 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.489142 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.489419 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.490085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:10.490398 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.491821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.506585 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 354/696] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:10.513987 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.596004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464d8f-09b9-4ddb-912d-698bd26ef9bd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.602206 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.670795 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.671726 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.672213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.672732 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.673925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:10.674448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.677117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.695544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 343/697] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:10.697214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.736406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2b3f0-131d-4f8f-a68e-831f87b79c9c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.828695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.829439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.829725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.830033 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.847363 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.851600 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:10.881750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:10.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:45:10.883733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:10.888352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 355/698] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:10.893211 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.905890 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9822e-aca2-48f5-a897-482ef39d4f5e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.988102 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.989914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.990296 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.991026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.993493 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.995224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] RBAC: Adding query filter params (interface=public, service_id=ac6ed36b9f1b4629a8ea52ea511c199f, region_id=RegionOne) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:10.996645 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.002875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.020718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 344/699] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/endpoints?service_id=ac6ed36b9f1b4629a8ea52ea511c199f&interface=public®ion_id=RegionOne => generated 194 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.024091 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.097058 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.098238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fba331-39b9-4dfa-a4fb-c5fd7c5141bf None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.164015 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.165141 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.165539 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.166034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.167319 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:11.168486 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.171206 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.208086 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 356/700] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:11.214663 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.246041 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ce3e6-be37-4e7e-898e-b30f7f002e80 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.289079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.289975 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.290434 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.290874 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.291652 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.293951 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.309101 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 345/701] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/services => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:45:11.380876 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e80a5c-5e45-48ba-b8f5-e9cbebe6bfcf None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.393825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.430569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.431632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.432143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.432680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.522370 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.524196 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.639661 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 357/702] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 16 00:45:11.645231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.785632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.794526 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92417f-267c-4894-b154-6a6c41fd1e65 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.837549 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119abab-0a57-4a9d-b738-443bb574e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.838514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119abab-0a57-4a9d-b738-443bb574e7cd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.838967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119abab-0a57-4a9d-b738-443bb574e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.839405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119abab-0a57-4a9d-b738-443bb574e7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.853183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119abab-0a57-4a9d-b738-443bb574e7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.854943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119abab-0a57-4a9d-b738-443bb574e7cd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c119abab-0a57-4a9d-b738-443bb574e7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:11.873894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:11.875195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:11.876462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:11.876462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:11.876462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:11.878631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 346/703] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:11.887036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.904948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.017226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31966105-ae25-4690-8a54-ee83a850d315 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.017527 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31966105-ae25-4690-8a54-ee83a850d315 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.017870 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31966105-ae25-4690-8a54-ee83a850d315 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.019621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 347/704] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:12.025693 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b39c-92a6-47ca-bcf7-c59dd5bb78ca None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.025953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b39c-92a6-47ca-bcf7-c59dd5bb78ca None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.026302 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b39c-92a6-47ca-bcf7-c59dd5bb78ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.046721 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-38a2b39c-92a6-47ca-bcf7-c59dd5bb78ca None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:12.047955 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-38a2b39c-92a6-47ca-bcf7-c59dd5bb78ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:12.083251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b4a36-7262-496a-a8e4-202348163303 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.147447 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 348/705] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:12.152456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.153963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.154697 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.155425 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.156884 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:12.157694 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.160660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.185342 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 358/706] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:12.196179 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b39c-92a6-47ca-bcf7-c59dd5bb78ca None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.359579 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.403174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b39c-92a6-47ca-bcf7-c59dd5bb78ca None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.429188 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.459409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.460755 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.461265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.461735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.471561 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.473470 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:12.487056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:12.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:12.488956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:12.491603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 349/707] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:12.502327 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.565705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.621083 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc0106-4e0a-45d1-bb24-ec8d13f1ce72 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.642335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d4ae-81fd-498d-9b13-a18e27a84e27 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.661212 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.662189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.662697 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.663165 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.664062 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:12.664611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.666356 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.674403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.680947 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 350/708] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:12.692478 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.715530 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.716813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.717312 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.717793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.718540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.721502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:12.740351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:12.741415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:12.742270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:12.748960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 359/709] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:12.753028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.813389 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bc5e1-0acb-47a7-affc-eb16cf04ebf3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.852403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1728b-12b0-4539-b349-1fbecdc7994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.853436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1728b-12b0-4539-b349-1fbecdc7994a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.853918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1728b-12b0-4539-b349-1fbecdc7994a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.854395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1728b-12b0-4539-b349-1fbecdc7994a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.855906 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1728b-12b0-4539-b349-1fbecdc7994a None admin] RBAC: Adding query filter params (role.id=5bb82326b88e4e608aa7a93aaf5626b5, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=bd96097b685d4e329ec46d0cfa19bfe1) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:12.856485 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1728b-12b0-4539-b349-1fbecdc7994a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.858288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1728b-12b0-4539-b349-1fbecdc7994a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.865580 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 351/710] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/role_assignments?user.id=bd96097b685d4e329ec46d0cfa19bfe1&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=5bb82326b88e4e608aa7a93aaf5626b5 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:12.974883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d4862-c6b4-4782-9b10-c429accc183e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:13.034099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:13.046838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:13.048497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.048497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.048850 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.049962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:13.050473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:13.053083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:13.064098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 360/711] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:13.073001 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:13.073798 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d7dc-18e5-413d-91ef-417e014732b1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.074397 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d7dc-18e5-413d-91ef-417e014732b1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.074916 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d7dc-18e5-413d-91ef-417e014732b1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.078743 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 352/712] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:13.088274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8e92-4148-42ac-ad86-dd95d1f46bda None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.089517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8e92-4148-42ac-ad86-dd95d1f46bda None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.089517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8e92-4148-42ac-ad86-dd95d1f46bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.116627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a36e8e92-4148-42ac-ad86-dd95d1f46bda None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:13.118182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a36e8e92-4148-42ac-ad86-dd95d1f46bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:13.251308 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9e92-4d22-4bc4-afcc-9cea332e767c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:13.254477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:13.279664 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 353/713] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:13.317844 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:13.319149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.319835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.320622 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.321860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:13.322581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:13.326050 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:13.335917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 361/714] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:45:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:13.811918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef90d-3b92-4071-be8f-7f1a83ddc6a3 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.812541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef90d-3b92-4071-be8f-7f1a83ddc6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.812950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef90d-3b92-4071-be8f-7f1a83ddc6a3 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.815631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 354/715] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:13.817107 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:13.826469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f16c-e74d-4166-ae54-23222cb7e442 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.826959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f16c-e74d-4166-ae54-23222cb7e442 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.827439 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f16c-e74d-4166-ae54-23222cb7e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.870629 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5731f16c-e74d-4166-ae54-23222cb7e442 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:13.873403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5731f16c-e74d-4166-ae54-23222cb7e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:13.909944 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:13.972360 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 355/716] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:13.986150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5b3b-3ee5-4749-a911-41f667a9355b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:14.023677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:14.024350 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.024628 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.024904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.025490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:14.026883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:14.037456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:14.039382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:14.041063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 362/717] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:14.045877 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731f16c-e74d-4166-ae54-23222cb7e442 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:14.247429 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731f16c-e74d-4166-ae54-23222cb7e442 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:14.295648 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:14.316381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:14.317395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.317875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.318360 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.319649 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:14.320173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:14.322759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:14.332976 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 356/718] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:14.341533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:14.439656 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:14.478410 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7947b5-b5af-46a1-b4f8-25820fd04e0a None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:14.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:14.533165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:14.534158 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.534630 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.535083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.536748 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:14.537275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:14.539204 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:14.551750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 363/719] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:14.553562 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:14.638592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f205bd-4d7a-4b1f-b470-288d9c6a7625 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:14.694079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661264f-a2e7-4141-9b43-56688f5dd7a9 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:14.697983 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:14.700326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.700929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.701498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.702614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:14.705400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:14.722919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:14.723963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:14.724864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:14.732950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 357/720] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:14.733960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:14.734684 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.734969 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.735241 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.736079 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:14.736196 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:14.737505 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:14.765681 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 364/721] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:45:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:14.850032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:14.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5418fe0-672d-492d-a938-1f4b04002876 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.038095 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.039110 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.039599 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.040146 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.041290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:15.041826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:15.045177 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:15.055111 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 358/722] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:15.064506 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:15.125700 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:15.241196 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d39c8-4f74-489e-83cb-a877a24ef732 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.285155 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e7858-1d9a-4862-b32a-f26e4a019d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.285812 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7858-1d9a-4862-b32a-f26e4a019d07 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.286107 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7858-1d9a-4862-b32a-f26e4a019d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.286383 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7858-1d9a-4862-b32a-f26e4a019d07 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.287067 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e7858-1d9a-4862-b32a-f26e4a019d07 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:15.287374 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e7858-1d9a-4862-b32a-f26e4a019d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:15.288998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e7858-1d9a-4862-b32a-f26e4a019d07 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:15.296091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 365/723] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:15.303812 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:15.491805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f4bd-2fd3-4e0f-8c06-e45cbc8756dd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.513933 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:15.556825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148f952-94f6-4600-8d1e-67d9a601b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.557802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148f952-94f6-4600-8d1e-67d9a601b681 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.558889 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148f952-94f6-4600-8d1e-67d9a601b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.559455 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148f952-94f6-4600-8d1e-67d9a601b681 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.560719 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148f952-94f6-4600-8d1e-67d9a601b681 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:15.563231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148f952-94f6-4600-8d1e-67d9a601b681 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:15.604429 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 359/724] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:45:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:15.741846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100076-68f4-46e8-bf63-1db4d36d5889 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.743511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100076-68f4-46e8-bf63-1db4d36d5889 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.744305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100076-68f4-46e8-bf63-1db4d36d5889 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.748120 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 366/725] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:15.754978 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ed26-9363-428f-8ddc-bd653970ffe9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.755957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ed26-9363-428f-8ddc-bd653970ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.756793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ed26-9363-428f-8ddc-bd653970ffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.791274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3122ed26-9363-428f-8ddc-bd653970ffe9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:15.794754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3122ed26-9363-428f-8ddc-bd653970ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:15.915991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 360/726] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:16.206420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29100076-68f4-46e8-bf63-1db4d36d5889 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:16.374764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29100076-68f4-46e8-bf63-1db4d36d5889 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:16.389169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:16.439059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:16.440099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.440620 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.441116 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] PATH_INFO: `/v3/services/image` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.442184 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:16.444674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:16.463280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:16.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:16.469692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 367/727] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 16 00:45:16 2022] GET /identity/v3/services/image => generated 86 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:16.476594 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ed26-9363-428f-8ddc-bd653970ffe9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:16.607425 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:16.616685 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ed26-9363-428f-8ddc-bd653970ffe9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:16.655434 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9802dca-2ecb-40e5-87e6-83a8df3348a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:16.656217 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9802dca-2ecb-40e5-87e6-83a8df3348a6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.656535 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9802dca-2ecb-40e5-87e6-83a8df3348a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.656810 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9802dca-2ecb-40e5-87e6-83a8df3348a6 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.657457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9802dca-2ecb-40e5-87e6-83a8df3348a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:16.657763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9802dca-2ecb-40e5-87e6-83a8df3348a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:16.659144 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9802dca-2ecb-40e5-87e6-83a8df3348a6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:16.664523 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 361/728] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:16.674666 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:16.693265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64135169-19e3-46b4-8163-750df8e42c14 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.693554 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64135169-19e3-46b4-8163-750df8e42c14 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.693836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64135169-19e3-46b4-8163-750df8e42c14 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.695430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 362/729] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:16.701680 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22fc2-72e2-4cea-952b-07fe1bc417fa None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.701962 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22fc2-72e2-4cea-952b-07fe1bc417fa None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.702237 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22fc2-72e2-4cea-952b-07fe1bc417fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.723838 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-24a22fc2-72e2-4cea-952b-07fe1bc417fa None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:16.725457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-24a22fc2-72e2-4cea-952b-07fe1bc417fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:16.804623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 363/730] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:16.868453 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3524a7-6bf2-427a-927a-93708601705e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:16.932994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2945ef-edb5-4ff0-a427-3b592c8f4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:16.934525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2945ef-edb5-4ff0-a427-3b592c8f4347 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.935010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2945ef-edb5-4ff0-a427-3b592c8f4347 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.935492 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2945ef-edb5-4ff0-a427-3b592c8f4347 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.936678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2945ef-edb5-4ff0-a427-3b592c8f4347 None admin] RBAC: Adding query filter params (type=image) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:16.937221 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2945ef-edb5-4ff0-a427-3b592c8f4347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:16.939935 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2945ef-edb5-4ff0-a427-3b592c8f4347 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:16.949377 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 368/731] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:17.086352 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22fc2-72e2-4cea-952b-07fe1bc417fa None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.187666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.211618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22fc2-72e2-4cea-952b-07fe1bc417fa None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.258110 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eed284-b421-48a7-9501-ea2eb860b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed284-b421-48a7-9501-ea2eb860b961 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.259019 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed284-b421-48a7-9501-ea2eb860b961 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.259297 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed284-b421-48a7-9501-ea2eb860b961 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.259991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eed284-b421-48a7-9501-ea2eb860b961 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.261995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eed284-b421-48a7-9501-ea2eb860b961 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.281036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 364/732] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:17 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:17.994689 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274bad-cf9f-436e-aa36-73b7e3d20929 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.995520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274bad-cf9f-436e-aa36-73b7e3d20929 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.995720 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274bad-cf9f-436e-aa36-73b7e3d20929 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.999058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 369/733] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:18.007678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca17bc-9054-41a4-bfb9-d5d9eb2a33c3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:18.008144 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca17bc-9054-41a4-bfb9-d5d9eb2a33c3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:18.008663 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca17bc-9054-41a4-bfb9-d5d9eb2a33c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:18.038138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-56ca17bc-9054-41a4-bfb9-d5d9eb2a33c3 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:18.040146 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-56ca17bc-9054-41a4-bfb9-d5d9eb2a33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:18.351450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 365/734] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:18.846673 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274bad-cf9f-436e-aa36-73b7e3d20929 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:18.906848 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:19.010397 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274bad-cf9f-436e-aa36-73b7e3d20929 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:19.050074 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:19.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.050981 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.051257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.052001 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:19.053573 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:19.056363 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING keystone.server.flask.common [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 16 00:45:19.078640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.sql.core [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:45:19.078640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:45:19.078640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [parameters: {'id': 'ac6ca86842e94ddcb162dc73bb18b4a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 00:45:19.078640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac6ca86842e94ddcb162dc73bb18b4a1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac6ca86842e94ddcb162dc73bb18b4a1. Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:19.087245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:45:19.088140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application yield resource Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise self.value Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application session.commit() Oct 16 00:45:19.089139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:45:19.090693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:45:19.091631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:19.093415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [parameters: {'id': 'ac6ca86842e94ddcb162dc73bb18b4a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:19.095390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:19.097381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac6ca86842e94ddcb162dc73bb18b4a1. Oct 16 00:45:19.101037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.101534 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571eb1-18ea-465e-b2b6-fea705feb327 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.101534 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571eb1-18ea-465e-b2b6-fea705feb327 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.101534 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571eb1-18ea-465e-b2b6-fea705feb327 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.101735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 370/735] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Oct 16 00:45:18 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:19.101806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 366/736] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:19.101806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53daf6-9f54-4483-8857-32b6914badbb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.101806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53daf6-9f54-4483-8857-32b6914badbb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.101806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53daf6-9f54-4483-8857-32b6914badbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.102033 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:19.125915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-8c53daf6-9f54-4483-8857-32b6914badbb None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:19.127498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8c53daf6-9f54-4483-8857-32b6914badbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:19.232712 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f24e9-4bdd-44a3-aa5f-b485ca9d5984 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:19.236813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:19.252942 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 367/737] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:19.273538 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:19.274193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.274477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.274822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.283473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:19.285437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:19.298248 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:19.300028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.301931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 371/738] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:19.307027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53daf6-9f54-4483-8857-32b6914badbb None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:19.310402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:19.426757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53daf6-9f54-4483-8857-32b6914badbb None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:19.466800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdd69-7435-4f20-b8ca-410cdda3910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:19.467436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdd69-7435-4f20-b8ca-410cdda3910b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.467716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdd69-7435-4f20-b8ca-410cdda3910b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.467990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdd69-7435-4f20-b8ca-410cdda3910b None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.468739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfdd69-7435-4f20-b8ca-410cdda3910b None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:19.469045 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfdd69-7435-4f20-b8ca-410cdda3910b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:19.470543 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfdd69-7435-4f20-b8ca-410cdda3910b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:19.491668 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 368/739] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:45:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:19.564348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:19.692236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5180bf-7484-4b90-863f-f01fa3b0d729 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.692544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5180bf-7484-4b90-863f-f01fa3b0d729 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.692876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5180bf-7484-4b90-863f-f01fa3b0d729 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.694520 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 369/740] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:19.701383 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448fd1d-8dcf-49c1-94b7-7455cca60d7e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.701642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448fd1d-8dcf-49c1-94b7-7455cca60d7e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.701929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448fd1d-8dcf-49c1-94b7-7455cca60d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.728347 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0448fd1d-8dcf-49c1-94b7-7455cca60d7e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:19.729789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0448fd1d-8dcf-49c1-94b7-7455cca60d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:19.748005 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b9de-38fb-4ded-ad33-498d6958260e None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:19.818796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:19.819517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.819796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.820070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.821041 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:19.822178 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:19.832941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:19.833445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:19.834390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:19.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 372/741] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:19.842229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:19.861789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 370/742] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:19.869902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:19.970333 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c68d-965d-4a95-bd07-4342eafc1c09 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.015230 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.016528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.016986 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.017423 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.018513 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:20.019007 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.021571 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.044509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 373/743] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:20.047115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448fd1d-8dcf-49c1-94b7-7455cca60d7e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.185170 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.226176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448fd1d-8dcf-49c1-94b7-7455cca60d7e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.273619 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cb04-4834-4a8d-8007-d61b518fa320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.274241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cb04-4834-4a8d-8007-d61b518fa320 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.274516 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cb04-4834-4a8d-8007-d61b518fa320 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.274787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cb04-4834-4a8d-8007-d61b518fa320 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.275424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cb04-4834-4a8d-8007-d61b518fa320 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:20.275798 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cb04-4834-4a8d-8007-d61b518fa320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.277525 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cb04-4834-4a8d-8007-d61b518fa320 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 371/744] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:20.284625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d6ba-e024-4853-b89d-3367cff6d5ce None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.284911 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d6ba-e024-4853-b89d-3367cff6d5ce None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.285189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d6ba-e024-4853-b89d-3367cff6d5ce None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.291309 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 372/745] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:20.293193 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d6ba-e024-4853-b89d-3367cff6d5ce None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.325702 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.364065 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757985a-ca15-4089-ad11-d8a0fd0a390d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.366493 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.421787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d6ba-e024-4853-b89d-3367cff6d5ce None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.424677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c4223-f654-43e2-83e3-2b3e4ea259e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.425895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c4223-f654-43e2-83e3-2b3e4ea259e3 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.426406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c4223-f654-43e2-83e3-2b3e4ea259e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.426887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c4223-f654-43e2-83e3-2b3e4ea259e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.427948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c4223-f654-43e2-83e3-2b3e4ea259e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.430498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c4223-f654-43e2-83e3-2b3e4ea259e3 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-dd2c4223-f654-43e2-83e3-2b3e4ea259e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:20.448462 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:20.450162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:20.450989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:20.453869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 374/746] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:20.455274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748014b6-5d39-457e-a263-8fb43b1bf1ec None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.455558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748014b6-5d39-457e-a263-8fb43b1bf1ec None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.455860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748014b6-5d39-457e-a263-8fb43b1bf1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.467630 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.468687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.468687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.468974 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.469553 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] RBAC: Adding query filter params (interface=admin, service_id=ac6ed36b9f1b4629a8ea52ea511c199f, region_id=RegionOne) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:20.469874 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.471341 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.487405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 373/747] 10.222.0.23 () {56 vars in 1249 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/endpoints?service_id=ac6ed36b9f1b4629a8ea52ea511c199f&interface=admin®ion_id=RegionOne => generated 193 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:20.487405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.597963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-748014b6-5d39-457e-a263-8fb43b1bf1ec None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:20.599603 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-748014b6-5d39-457e-a263-8fb43b1bf1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:20.616581 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d64f1-9471-4623-b8c0-5b8f49cbca89 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.649042 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.667024 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.667886 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.668182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.668533 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.669127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:20.669430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.670844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.676570 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 374/748] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:20.677454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.709077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 375/749] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:20.709077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748014b6-5d39-457e-a263-8fb43b1bf1ec None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.812030 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280b098-f2c2-424c-8b02-c211879a5519 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.836181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.851694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.852623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.853105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.853525 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.854314 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.856720 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.864996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 375/750] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:45:20.890831 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748014b6-5d39-457e-a263-8fb43b1bf1ec None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.930668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.931551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.932034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.932503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.933607 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:20.934300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.935950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.942180 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 376/751] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:20.952231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.023907 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.057381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.151930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47541-c0b7-4c76-9120-a1a88a3a4ed8 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.156688 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621771-c228-4b49-a418-4e38f1ee6783 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.195559 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.196589 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.199758 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.200298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.201199 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.202804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.209017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.236387 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 377/752] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:21 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:21.259160 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70594a7e-3917-4ad1-8594-6b6a663d4329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.260531 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594a7e-3917-4ad1-8594-6b6a663d4329 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.261685 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594a7e-3917-4ad1-8594-6b6a663d4329 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.262320 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594a7e-3917-4ad1-8594-6b6a663d4329 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.263732 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70594a7e-3917-4ad1-8594-6b6a663d4329 None admin] RBAC: Adding query filter params (interface=public, service_id=d0313aeb12e54acc9915e844f67e7a4d, region_id=RegionOne) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:21.264507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70594a7e-3917-4ad1-8594-6b6a663d4329 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.267152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70594a7e-3917-4ad1-8594-6b6a663d4329 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.277851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 376/753] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/endpoints?service_id=d0313aeb12e54acc9915e844f67e7a4d&interface=public®ion_id=RegionOne => generated 194 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:21.287913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.489429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbbb8e-9287-4f31-b0d0-ea77c2f76622 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.550399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e2bb3-2534-4a2c-845a-612446c6421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.551739 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e2bb3-2534-4a2c-845a-612446c6421b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.552441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e2bb3-2534-4a2c-845a-612446c6421b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.553118 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e2bb3-2534-4a2c-845a-612446c6421b None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.554404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e2bb3-2534-4a2c-845a-612446c6421b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.557176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e2bb3-2534-4a2c-845a-612446c6421b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.571955 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 378/754] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/services => generated 1957 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:45:22.005217 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe081bb-9951-4bd8-8cab-dfb901b5ff91 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.006014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe081bb-9951-4bd8-8cab-dfb901b5ff91 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.006014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe081bb-9951-4bd8-8cab-dfb901b5ff91 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.007400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 377/755] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:22.014549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518bbd-3e91-42d4-9cbb-8f254f1cebc1 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.014882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518bbd-3e91-42d4-9cbb-8f254f1cebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.015145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518bbd-3e91-42d4-9cbb-8f254f1cebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.035391 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-ea518bbd-3e91-42d4-9cbb-8f254f1cebc1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:22.036624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-ea518bbd-3e91-42d4-9cbb-8f254f1cebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:22.126896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:22.147480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 379/756] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:22 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:22.439442 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe081bb-9951-4bd8-8cab-dfb901b5ff91 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:22.580304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe081bb-9951-4bd8-8cab-dfb901b5ff91 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:22.591842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:22.628673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:22.629764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.630382 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.630899 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.631803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:22.633512 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:22.637765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING keystone.server.flask.common [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 16 00:45:22.653690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.sql.core [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:45:22.653690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 16 00:45:22.653690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [parameters: {'user_id': 'e156b2767c7e47e6bdff73bc91dab8e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 16 00:45:22.653690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:22.662991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:22.664194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application yield resource Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise self.value Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application session.commit() Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:45:22.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:45:22.666763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:22.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:22.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e156b2767c7e47e6bdff73bc91dab8e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:22.673515 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 16 00:45:22.676610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 16 00:45:22.684623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 16 00:45:22.684623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 16 00:45:22.684623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:45:22.684623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:45:22.684623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 16 00:45:22.684623 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:22.685711 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 378/757] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 16 00:45:22 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:22.691916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518bbd-3e91-42d4-9cbb-8f254f1cebc1 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:22.843969 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518bbd-3e91-42d4-9cbb-8f254f1cebc1 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:22.907897 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b14b-c146-4fba-b43b-883987a3a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:22.908909 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b14b-c146-4fba-b43b-883987a3a6fe None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.909337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b14b-c146-4fba-b43b-883987a3a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.909758 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b14b-c146-4fba-b43b-883987a3a6fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.923347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5b14b-c146-4fba-b43b-883987a3a6fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:22.925926 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5b14b-c146-4fba-b43b-883987a3a6fe None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9db5b14b-c146-4fba-b43b-883987a3a6fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:22.947623 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:22.949554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:22.952159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 380/758] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:22.965546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:23.129173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968a00-c931-4af6-9aa5-ae4c8933cd76 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:23.167875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0521c7-d0fa-4faf-bc2a-8256652e3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:23.168899 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0521c7-d0fa-4faf-bc2a-8256652e3213 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.169390 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0521c7-d0fa-4faf-bc2a-8256652e3213 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.169913 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0521c7-d0fa-4faf-bc2a-8256652e3213 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.170884 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0521c7-d0fa-4faf-bc2a-8256652e3213 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:23.171393 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0521c7-d0fa-4faf-bc2a-8256652e3213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:23.173309 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0521c7-d0fa-4faf-bc2a-8256652e3213 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:23.224742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 379/759] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:23.390669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563fbc-cfb4-403d-b818-eb0673391bf9 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.391220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563fbc-cfb4-403d-b818-eb0673391bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.391220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563fbc-cfb4-403d-b818-eb0673391bf9 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.393434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 381/760] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:23.403143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9732c-31ba-42af-ae86-07554f2d9760 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.403410 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9732c-31ba-42af-ae86-07554f2d9760 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.403769 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9732c-31ba-42af-ae86-07554f2d9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.426298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2bc9732c-31ba-42af-ae86-07554f2d9760 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:23.428129 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2bc9732c-31ba-42af-ae86-07554f2d9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:23.457146 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:23.519466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 380/761] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:23 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:23.768119 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c956-80d6-4642-a96d-cc091a241924 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.768608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c956-80d6-4642-a96d-cc091a241924 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.768761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c956-80d6-4642-a96d-cc091a241924 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.770371 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 382/762] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:23.777947 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290a9ab-000c-4805-9163-8a0a7770c251 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.778409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290a9ab-000c-4805-9163-8a0a7770c251 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.778872 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290a9ab-000c-4805-9163-8a0a7770c251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.796845 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074c956-80d6-4642-a96d-cc091a241924 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:23.810940 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5290a9ab-000c-4805-9163-8a0a7770c251 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:23.812805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5290a9ab-000c-4805-9163-8a0a7770c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:23.859157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:23.899118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 381/763] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:23 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:23.922860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074c956-80d6-4642-a96d-cc091a241924 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:23.968881 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:23.969902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.970222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.970641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.971735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:23.974467 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:23.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:23.992013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:45:23.993294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:23.996735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 383/764] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 16 00:45:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:24.002715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290a9ab-000c-4805-9163-8a0a7770c251 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.137717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.162514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290a9ab-000c-4805-9163-8a0a7770c251 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.172824 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.236787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.237691 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.237993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.238282 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.238996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:24.239392 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.241173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.248360 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 382/765] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:24.255255 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.341730 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bfa44-76bc-4df0-88e3-415776f26ac4 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.366774 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.396390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.397299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.397633 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.398326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] PATH_INFO: `/v3/services/image` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.398588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.400153 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:24.414148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:24.415294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:24.416161 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:24.417015 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 384/766] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/services/image => generated 86 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:24.429366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.447315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826e40-47d3-4030-b73e-024bc5d91686 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.508710 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.509603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.510074 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.510547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.511723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:24.512245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.514803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.529168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 383/767] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:24.533968 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.560398 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.599863 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c64dcc-d6d0-4025-ac95-cbd38f72ca61 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.660764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629320d-f9f6-4049-a6a0-643fe72e999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.661639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629320d-f9f6-4049-a6a0-643fe72e999e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.662090 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629320d-f9f6-4049-a6a0-643fe72e999e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.662451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629320d-f9f6-4049-a6a0-643fe72e999e None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.663524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629320d-f9f6-4049-a6a0-643fe72e999e None admin] RBAC: Adding query filter params (name=image) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:24.663994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629320d-f9f6-4049-a6a0-643fe72e999e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.666134 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629320d-f9f6-4049-a6a0-643fe72e999e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.675890 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 385/768] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:24.678250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be3b75-1e6d-432d-b9e4-520a7887dc30 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.678823 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be3b75-1e6d-432d-b9e4-520a7887dc30 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.679297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be3b75-1e6d-432d-b9e4-520a7887dc30 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.681973 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 386/769] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:24.685322 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be3b75-1e6d-432d-b9e4-520a7887dc30 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.695259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a213b-5ffd-4adc-83e5-3abc84e1ce30 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.738908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922b522-c147-4414-905c-109f25741112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.739534 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922b522-c147-4414-905c-109f25741112 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.739905 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922b522-c147-4414-905c-109f25741112 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.740181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922b522-c147-4414-905c-109f25741112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.741176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922b522-c147-4414-905c-109f25741112 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.742021 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.742607 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922b522-c147-4414-905c-109f25741112 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.767820 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 384/770] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:45:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:24.769329 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d14a-d9a8-4c74-8886-d317487b7661 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.769642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d14a-d9a8-4c74-8886-d317487b7661 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.770196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d14a-d9a8-4c74-8886-d317487b7661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.803533 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d062d14a-d9a8-4c74-8886-d317487b7661 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:24.806325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d062d14a-d9a8-4c74-8886-d317487b7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:24.846432 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be3b75-1e6d-432d-b9e4-520a7887dc30 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.894701 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.895696 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.896109 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.896424 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.897633 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:24.897899 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.899795 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.915565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 387/771] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:24.918713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.933037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 385/772] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:25.069353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ccbdd-136f-4f12-b11b-ded5c0e439a5 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.071498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.114491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.115211 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.115563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.115907 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.116723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] RBAC: Adding query filter params (interface=public, service_id=e53546ed1fc64dea899cef014ff67318, region_id=RegionOne) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:25.117105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.118564 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.125787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 388/773] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/endpoints?service_id=e53546ed1fc64dea899cef014ff67318&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:25.131602 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d14a-d9a8-4c74-8886-d317487b7661 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.142562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.263969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d14a-d9a8-4c74-8886-d317487b7661 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.264727 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.304425 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.305052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.305351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.305611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.306236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.307629 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.316188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 386/774] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:45:25.390869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5b571-fd63-46d6-99e1-985c49c8d442 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.438985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.439972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.439972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.440262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.440856 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.442285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:25.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:25.455177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:45:25.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:25.466026 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 389/775] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:25.466248 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.546361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.582696 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47bc9e-c512-4b86-9974-249697c6a686 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.622321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.623046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.623417 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.623840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.624699 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:25.625088 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.636503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 387/776] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:25.640367 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.675741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.766576 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24bae-1bb9-4b96-b72e-0892a522bd73 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.807502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bee5a0-ed49-4df0-b033-0c3b746cfa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.808854 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bee5a0-ed49-4df0-b033-0c3b746cfa24 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.809260 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bee5a0-ed49-4df0-b033-0c3b746cfa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.809631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bee5a0-ed49-4df0-b033-0c3b746cfa24 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.810441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bee5a0-ed49-4df0-b033-0c3b746cfa24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:25.810844 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bee5a0-ed49-4df0-b033-0c3b746cfa24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.812390 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bee5a0-ed49-4df0-b033-0c3b746cfa24 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.824484 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 390/777] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:25.828094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:26.000845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0cd3c-419e-461b-96c0-a5b373bde76f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:26.056861 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e45ea7-9209-47c4-b2c4-d252fed707ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:26.057928 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e45ea7-9209-47c4-b2c4-d252fed707ce None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:26.058353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e45ea7-9209-47c4-b2c4-d252fed707ce None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:26.058824 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e45ea7-9209-47c4-b2c4-d252fed707ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:26.059979 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e45ea7-9209-47c4-b2c4-d252fed707ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:26.062456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e45ea7-9209-47c4-b2c4-d252fed707ce None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:26.070215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:26.100375 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 388/778] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:45:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:27.183493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa8c6-8fee-461f-84d8-43290002c307 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.184696 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa8c6-8fee-461f-84d8-43290002c307 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.184696 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa8c6-8fee-461f-84d8-43290002c307 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.185714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 391/779] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:27.191261 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef63e8-823f-497f-8c66-b8a72a8e25cb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.191805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef63e8-823f-497f-8c66-b8a72a8e25cb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.191805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef63e8-823f-497f-8c66-b8a72a8e25cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.214322 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-20ef63e8-823f-497f-8c66-b8a72a8e25cb None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:27.215621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-20ef63e8-823f-497f-8c66-b8a72a8e25cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:27.331482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 389/780] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:27.606131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aa8c6-8fee-461f-84d8-43290002c307 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.650507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543256-738a-492d-8d35-79d36606d3c9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.650791 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543256-738a-492d-8d35-79d36606d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.651073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543256-738a-492d-8d35-79d36606d3c9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.653567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 390/781] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:27.659143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0111-5a16-40de-b6a1-fbae4d328919 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.659430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0111-5a16-40de-b6a1-fbae4d328919 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.659706 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0111-5a16-40de-b6a1-fbae4d328919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.684042 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-94cc0111-5a16-40de-b6a1-fbae4d328919 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:27.686115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-94cc0111-5a16-40de-b6a1-fbae4d328919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:27.720885 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.731286 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aa8c6-8fee-461f-84d8-43290002c307 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.768786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 391/782] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:27.774943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.774943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.774943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.774943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.775276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.775276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.776002 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 392/783] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:27.781954 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0111-5a16-40de-b6a1-fbae4d328919 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.845928 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.909681 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0111-5a16-40de-b6a1-fbae4d328919 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.946367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.946986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.947283 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.947552 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.948196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.950208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.988341 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 392/784] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:27 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:28.053000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:28.177024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb92431-5ea5-4f4f-8456-ac10da430707 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:28.223041 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:28.223703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.223982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.224208 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.224843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:28.226222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:28.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:28.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:28.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 393/785] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 16 00:45:28 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:28.245088 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:28.351216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:28.357713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f4450-607e-4172-8397-4516d65ddc78 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:28.400229 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:28.400857 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.401140 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.402118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.402845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:28.403305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:28.404676 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:28.413064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 393/786] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:28.419734 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:28.458031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:28.555110 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c119e-16f8-4c9c-9fba-4370528679f7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:28.597091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eb061-730f-4c96-89e8-324ce8687135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:28.597745 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eb061-730f-4c96-89e8-324ce8687135 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.598030 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eb061-730f-4c96-89e8-324ce8687135 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.598403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eb061-730f-4c96-89e8-324ce8687135 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.599225 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eb061-730f-4c96-89e8-324ce8687135 None admin] RBAC: Adding query filter params (type=image) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:28.599660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eb061-730f-4c96-89e8-324ce8687135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:28.601319 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eb061-730f-4c96-89e8-324ce8687135 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:28.614774 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 394/787] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:28.616205 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:28.644908 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052aba3-4aca-46e5-bf1f-b9c2354e1a09 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.645235 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052aba3-4aca-46e5-bf1f-b9c2354e1a09 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.645510 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052aba3-4aca-46e5-bf1f-b9c2354e1a09 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.647095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 395/788] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:28.652426 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242c26-51fb-4492-9b93-6ecd0318d978 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.652787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242c26-51fb-4492-9b93-6ecd0318d978 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.652983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242c26-51fb-4492-9b93-6ecd0318d978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.671977 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-c0242c26-51fb-4492-9b93-6ecd0318d978 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:28.673198 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c0242c26-51fb-4492-9b93-6ecd0318d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:28.735717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e621a1-4e13-42ce-9ffd-d2b3c57c5dc1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:28.752069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 396/789] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:28.775882 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:28.776708 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.777033 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.777292 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.778067 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:28.779449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:28.804037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 394/790] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:45:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:29.022832 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242c26-51fb-4492-9b93-6ecd0318d978 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:29.049975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:29.166275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242c26-51fb-4492-9b93-6ecd0318d978 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:29.233228 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:29.234327 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:29.234556 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:29.234770 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:29.250144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:29.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:29.258558 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:29.265060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 397/791] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 16 00:45:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:29.267863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:29.287428 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:29.403209 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90fc9-e2e1-471b-b66c-4176e124ce17 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:29.441918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:29.442532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:29.442813 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:29.443088 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:29.443765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:29.444069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:29.445504 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:29.455659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 395/792] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 16 00:45:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:29.462379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:29.549037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:29.576768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831dc1a-6fdd-4d32-ad7d-0798f9e2e656 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:29.618491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:29.619411 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:29.619909 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:29.621190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:29.639866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:29.642221 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:29.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:29.663285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:29.664923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:29.664923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:29.664923 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:29.665471 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 398/793] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:29.669069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:29.773437 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:29.802714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235365d-7544-4232-8bec-a33f38744d11 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:29.862692 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:29.863742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:29.864216 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:29.864698 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:29.865842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:29.866379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:29.868682 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:29.896081 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 396/794] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:29.897329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.012181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa27a9-98d4-41c4-a680-1b80b24f7b08 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.044677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.054529 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.055095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.055369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.055647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.064552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.066020 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:30.078079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:30.079091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:30.080213 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 399/795] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 16 00:45:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:30.087296 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.217843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34cd6c-ce10-4547-abeb-e770c39c836a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.262452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbedfdf-9143-4817-a734-1c24e2a6408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.263067 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbedfdf-9143-4817-a734-1c24e2a6408d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.263352 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbedfdf-9143-4817-a734-1c24e2a6408d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.263628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbedfdf-9143-4817-a734-1c24e2a6408d None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.264493 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbedfdf-9143-4817-a734-1c24e2a6408d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:30.264808 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbedfdf-9143-4817-a734-1c24e2a6408d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.266557 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbedfdf-9143-4817-a734-1c24e2a6408d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.278539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.293473 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 397/796] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:30.295118 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.306480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8dca8-bdca-488e-9ea9-c106aea5da3c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.306790 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8dca8-bdca-488e-9ea9-c106aea5da3c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.307192 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8dca8-bdca-488e-9ea9-c106aea5da3c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.309377 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 398/797] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:30.315111 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd52e-ee59-4e35-aceb-cb4d56311192 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.315404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd52e-ee59-4e35-aceb-cb4d56311192 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.315679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd52e-ee59-4e35-aceb-cb4d56311192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.336489 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e17dd52e-ee59-4e35-aceb-cb4d56311192 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:30.337707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e17dd52e-ee59-4e35-aceb-cb4d56311192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:30.427959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b07e8d-8018-4eaa-b669-34dd411bad0c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.436348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 399/798] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:30.472122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.472910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.474172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.474457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.487222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.488724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:30.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:30.506136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:30.507105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:30.507105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:30.507105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:30.508630 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 400/799] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:30.512189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dd52e-ee59-4e35-aceb-cb4d56311192 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.647248 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dd52e-ee59-4e35-aceb-cb4d56311192 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.683938 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.697529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.698943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.699402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.699829 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.700665 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:30.701117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.702694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.713015 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.721032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 400/800] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:30.727272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.762160 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.828417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c97548-659f-4ede-a2e2-3d7bcb008e10 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.837702 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3931c-ff33-4541-81ee-18c8de1f1d93 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.865143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.865733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.866293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.867434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.868927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.870803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 401/801] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:30.874312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.875741 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.876246 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.876631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.884250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.886378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:30.898980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:30.900089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:30.901500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:30.906281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 401/802] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:30.907232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.968714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:31.021325 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c869-179a-4016-9781-5eb939bf6e78 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.035359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:31.045370 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd88b90-fc7c-47cc-b0bd-10da9a46d1dd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.072773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052e0c-ce37-4fc6-a8e7-42857030b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.073464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052e0c-ce37-4fc6-a8e7-42857030b37d None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.073747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052e0c-ce37-4fc6-a8e7-42857030b37d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.074012 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052e0c-ce37-4fc6-a8e7-42857030b37d None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.074796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052e0c-ce37-4fc6-a8e7-42857030b37d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.076242 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052e0c-ce37-4fc6-a8e7-42857030b37d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.082683 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.083294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.083571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.083843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.084828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:31.085141 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.086565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.100356 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 402/803] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:31.109100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 402/804] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:30 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:31.109308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:31.155311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465115d0-6655-41dc-a66a-6d885be9c29e None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.155499 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465115d0-6655-41dc-a66a-6d885be9c29e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.155783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465115d0-6655-41dc-a66a-6d885be9c29e None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.157317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 403/805] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:31.163091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ae68d-f7dd-4e95-9b1e-be73a51ce63a None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.163411 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ae68d-f7dd-4e95-9b1e-be73a51ce63a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.163643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ae68d-f7dd-4e95-9b1e-be73a51ce63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.183405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-737ae68d-f7dd-4e95-9b1e-be73a51ce63a None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:31.184983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-737ae68d-f7dd-4e95-9b1e-be73a51ce63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:31.236167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659642-c7b9-462a-947a-7f7e921cc01d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.250922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:31.271204 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 404/806] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:31.284038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.285041 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.285321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/94c3191543bd4843be4f6db40a98122b/roles/5bb82326b88e4e608aa7a93aaf5626b5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=94c3191543bd4843be4f6db40a98122b, role_id=5bb82326b88e4e608aa7a93aaf5626b5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.289794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.308718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 403/807] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:31 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/94c3191543bd4843be4f6db40a98122b/roles/5bb82326b88e4e608aa7a93aaf5626b5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:31.541130 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ae68d-f7dd-4e95-9b1e-be73a51ce63a None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:31.640761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:31.650237 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ae68d-f7dd-4e95-9b1e-be73a51ce63a None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.688166 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.688887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.689170 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.689445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.690139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.691506 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.700150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.sql.core [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:45:31.700150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:45:31.700150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [parameters: {'id': '946dec80f8524f18a5baaeac91e4dbe7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:45:31.700150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:31.707723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:45:31.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application yield resource Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise self.value Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application session.commit() Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:45:31.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:45:31.710752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:45:31.711631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:31.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [parameters: {'id': '946dec80f8524f18a5baaeac91e4dbe7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:45:31.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:31.714329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:31.715229 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 405/808] 10.222.0.23 () {60 vars in 1137 bytes} [Sun Oct 16 00:45:31 2022] POST /identity/v3/domains => generated 190 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:31.718787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:31.833194 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766a907-11d2-4692-81a3-e2b6105da36c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.871046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9f877-9a73-464c-aea8-38419dcfc7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.871706 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9f877-9a73-464c-aea8-38419dcfc7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.871991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9f877-9a73-464c-aea8-38419dcfc7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.872273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9f877-9a73-464c-aea8-38419dcfc7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.884257 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9f877-9a73-464c-aea8-38419dcfc7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.885814 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9f877-9a73-464c-aea8-38419dcfc7c0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3ff9f877-9a73-464c-aea8-38419dcfc7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:31.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:31.903999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:31.906281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:31.906281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:31.906281 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:31.907168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 404/809] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:31.909404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:32.019160 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ef51-0f49-47fd-8c3b-17ac5d676eba None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:32.054529 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f1cda-1255-4c97-925b-e5347ee5d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:32.055144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f1cda-1255-4c97-925b-e5347ee5d62e None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:32.055426 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f1cda-1255-4c97-925b-e5347ee5d62e None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:32.055701 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f1cda-1255-4c97-925b-e5347ee5d62e None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:32.056364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f1cda-1255-4c97-925b-e5347ee5d62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:32.056678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f1cda-1255-4c97-925b-e5347ee5d62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:32.058096 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f1cda-1255-4c97-925b-e5347ee5d62e None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:32.076359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 406/810] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:33.412267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d8826-2697-467d-baa7-95c3e51c4855 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.412910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d8826-2697-467d-baa7-95c3e51c4855 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.412910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d8826-2697-467d-baa7-95c3e51c4855 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.414220 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 405/811] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:33.420284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed31da-41b5-4f3c-b733-1e8400c83a0e None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.420843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed31da-41b5-4f3c-b733-1e8400c83a0e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.421076 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed31da-41b5-4f3c-b733-1e8400c83a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.441257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-8aed31da-41b5-4f3c-b733-1e8400c83a0e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:33.442446 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-8aed31da-41b5-4f3c-b733-1e8400c83a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:33.465643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:33.505232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8708a-20fc-4352-b114-6585fcc848d9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.505431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8708a-20fc-4352-b114-6585fcc848d9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.505685 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8708a-20fc-4352-b114-6585fcc848d9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.507013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 406/812] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:33.512501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5aa9-d2a8-4840-83dc-d76cf63b4bff None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.512793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5aa9-d2a8-4840-83dc-d76cf63b4bff None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.513085 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5aa9-d2a8-4840-83dc-d76cf63b4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.531022 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 407/813] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:33.531978 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7c3a5aa9-d2a8-4840-83dc-d76cf63b4bff None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:33.533247 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7c3a5aa9-d2a8-4840-83dc-d76cf63b4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:33.548835 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:33.635457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 407/814] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:33.796757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed31da-41b5-4f3c-b733-1e8400c83a0e None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.905321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a5aa9-d2a8-4840-83dc-d76cf63b4bff None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.911440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed31da-41b5-4f3c-b733-1e8400c83a0e None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:33.949906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:33.950549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.950838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.951106 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.962914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:33.968332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:33.969591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:33.970719 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 408/815] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:33.977259 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.989139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.030202 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a5aa9-d2a8-4840-83dc-d76cf63b4bff None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.069549 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.070088 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.070367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.070639 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.085808 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673a1af-de5f-4ab4-b602-144810c7a9f0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.088812 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:34.094003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:34.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:34.096348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 408/816] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:34.101186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.114657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.134117 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.134738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.135023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.135312 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.136780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:34.137095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.138518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.147658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 409/817] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:34.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.231751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeac785-aaf8-40e3-9bd6-27df09a1f9ad None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.238894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.272716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.273512 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.274118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.274397 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.275227 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:34.275530 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.277027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.277451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42c4a0-74ed-404b-bb6f-7a754996a8e2 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.286164 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 409/818] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:34.292176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.315613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.316269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.316589 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.316865 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] PATH_INFO: `/v3/users/52aeb75345ed40a4a6f16e9e409e4aa3` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.331841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] RBAC: Authorizing `identity:get_user(user_id=52aeb75345ed40a4a6f16e9e409e4aa3)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.333256 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.335222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 410/819] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/users/52aeb75345ed40a4a6f16e9e409e4aa3 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:34.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.378831 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.420706 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d28b60-d7c5-4e75-9785-954f100c319c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.465953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf47dc-d23c-473b-8470-e61fba5013a7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.473657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.474455 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.474825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.475196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.488656 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.490200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.499609 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:34.509052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:34.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:34.511757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:34.511757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:34.511757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:34.511950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.511950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.511950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.511950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] PATH_INFO: `/v3/projects/a549f5d333b1439bb186341cf516fbb0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.512234 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 410/820] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:34.512345 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] RBAC: Authorizing `identity:get_project(project_id=a549f5d333b1439bb186341cf516fbb0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.513174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.514995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 411/821] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/projects/a549f5d333b1439bb186341cf516fbb0 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:34.516671 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.521281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.636304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c953e-c894-46f2-9559-276253cb4777 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.638541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f440e5-2b34-483b-8bba-77d411e2bca6 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.663069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.675729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.676377 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.676663 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.676941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.677603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:34.677913 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.679309 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.681072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.681072 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.681307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.681501 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] PATH_INFO: `/v3/projects/a549f5d333b1439bb186341cf516fbb0/users/52aeb75345ed40a4a6f16e9e409e4aa3/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.684396 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] RBAC: Authorizing `identity:create_grant(project_id=a549f5d333b1439bb186341cf516fbb0, user_id=52aeb75345ed40a4a6f16e9e409e4aa3, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.685828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.697928 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 411/822] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:34.699232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.702778 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 412/823] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:34 2022] PUT /identity/v3/projects/a549f5d333b1439bb186341cf516fbb0/users/52aeb75345ed40a4a6f16e9e409e4aa3/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:45:34.823384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a0d38-d9b0-41be-9cc1-cd55c7010305 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.868649 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.869304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.869584 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.869855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.878739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.880208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:34.894408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:34.895618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:34.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 412/824] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:34.904975 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.973510 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:35.023487 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524b3ed-7d5e-40f2-bf9b-91cdaa58cf46 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:35.062069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:35.062690 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:35.062968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:35.063234 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:35.063974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:35.064274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:35.067259 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:35.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 413/825] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:35.092304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:35.145659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:35.204922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a72ff-a896-460a-ae3b-610c01aaf53c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:35.249172 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:35.249791 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:35.250218 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:35.250342 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:35.335219 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:35.336703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:35.386252 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:35.449758 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 413/826] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:45:35.455441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:35.556012 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a0668-c347-4c51-8cb8-c20371ae0723 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:35.569927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:35.591096 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:35.591764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:35.592046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:35.592347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:35.603888 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:35.606243 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:35.621611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:35.623226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:35.624455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:35.624455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:35.624455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:35.624455 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 414/827] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:35.628574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:35.729123 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a57a-a23e-4174-9bad-fd695dc6d6f3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:35.762617 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:35.763224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:35.763508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:35.763785 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:35.764457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:35.764766 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:35.766140 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:35.777914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 414/828] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:35.783459 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:35.880818 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05be8d-9e87-4123-bf4d-ceca118d2c75 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:35.913686 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:35.914310 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:35.914599 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:35.914871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:35.922070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:35.923525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:35.934838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:35.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:35.936934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 415/829] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:35.941811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:35.946637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:36.047158 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f7b46-b8d8-40cc-90ff-b701966c4161 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:36.080713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877a2b6-3222-4742-a79d-fcbb44794512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:36.081317 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877a2b6-3222-4742-a79d-fcbb44794512 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.081608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877a2b6-3222-4742-a79d-fcbb44794512 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.081868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877a2b6-3222-4742-a79d-fcbb44794512 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.082554 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877a2b6-3222-4742-a79d-fcbb44794512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:36.082858 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877a2b6-3222-4742-a79d-fcbb44794512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:36.084282 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877a2b6-3222-4742-a79d-fcbb44794512 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:36.097295 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 415/830] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:36.103352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:36.132460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:36.205057 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164219-49db-4e71-a64e-1aac9d4f0376 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:36.240141 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210ed5c-0c61-4cc0-8a98-ba367f2b253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:36.240776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ed5c-0c61-4cc0-8a98-ba367f2b253d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.241060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ed5c-0c61-4cc0-8a98-ba367f2b253d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.241333 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ed5c-0c61-4cc0-8a98-ba367f2b253d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.242053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210ed5c-0c61-4cc0-8a98-ba367f2b253d None admin] RBAC: Adding query filter params (role.id=5bb82326b88e4e608aa7a93aaf5626b5, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=94c3191543bd4843be4f6db40a98122b) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:36.242365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210ed5c-0c61-4cc0-8a98-ba367f2b253d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:36.243796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210ed5c-0c61-4cc0-8a98-ba367f2b253d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:36.250340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 416/831] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:36 2022] GET /identity/v3/role_assignments?user.id=94c3191543bd4843be4f6db40a98122b&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=5bb82326b88e4e608aa7a93aaf5626b5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:36.884449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d256c-3161-4778-ab4f-6564145c0778 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.884993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d256c-3161-4778-ab4f-6564145c0778 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.884993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d256c-3161-4778-ab4f-6564145c0778 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.886657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 416/832] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:36.892134 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff55a-857b-4fc3-804a-adca0d998ac5 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.892591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff55a-857b-4fc3-804a-adca0d998ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.892797 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff55a-857b-4fc3-804a-adca0d998ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.911638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-cd1ff55a-857b-4fc3-804a-adca0d998ac5 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:36.912850 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-cd1ff55a-857b-4fc3-804a-adca0d998ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:36.983933 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 417/833] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:37.259150 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d256c-3161-4778-ab4f-6564145c0778 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.327974 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:37.368412 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d256c-3161-4778-ab4f-6564145c0778 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.403402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.404052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.404359 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.404640 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.416486 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:37.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:37.423539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:37.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 417/834] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:37.430051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ff55a-857b-4fc3-804a-adca0d998ac5 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.453153 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:37.537043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ff55a-857b-4fc3-804a-adca0d998ac5 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.571283 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.571886 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.572886 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.572886 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.573888 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:37.574672 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:37.575270 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:37.583370 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 418/835] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:37.590400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.688339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54562f3-19ba-42b5-bed0-8f75a27901c4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.711385 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:37.723083 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.723714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.723997 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.724274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] PATH_INFO: `/v3/users/52aeb75345ed40a4a6f16e9e409e4aa3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.725436 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=52aeb75345ed40a4a6f16e9e409e4aa3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:37.726870 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:37.728487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 418/836] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/users/52aeb75345ed40a4a6f16e9e409e4aa3 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:37.734514 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.815459 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:37.834751 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde7fcc-2dea-4b5b-852e-85c2867da00c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.867167 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.867766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.868043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.934405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:37.935846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.013735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:38.032988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 419/837] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:45:38.039044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.138162 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36dcb-23b5-46f7-8cd7-4b9691c33ce5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.172963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005fa7a-7f0f-4050-89f7-1ca547563557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.173599 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005fa7a-7f0f-4050-89f7-1ca547563557 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.173877 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005fa7a-7f0f-4050-89f7-1ca547563557 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.174150 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005fa7a-7f0f-4050-89f7-1ca547563557 None admin] PATH_INFO: `/v3/projects/a549f5d333b1439bb186341cf516fbb0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.175250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005fa7a-7f0f-4050-89f7-1ca547563557 None admin] RBAC: Authorizing `identity:get_project(project_id=a549f5d333b1439bb186341cf516fbb0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.176696 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005fa7a-7f0f-4050-89f7-1ca547563557 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.178312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 419/838] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/projects/a549f5d333b1439bb186341cf516fbb0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:38.184808 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.283543 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115db948-8ea5-431e-bc4e-364ba8e40935 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.317883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39532e-c28c-4e51-827d-4662e3518f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.318492 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39532e-c28c-4e51-827d-4662e3518f0f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.318769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39532e-c28c-4e51-827d-4662e3518f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.319162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39532e-c28c-4e51-827d-4662e3518f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.319884 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39532e-c28c-4e51-827d-4662e3518f0f None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=a549f5d333b1439bb186341cf516fbb0, user.id=52aeb75345ed40a4a6f16e9e409e4aa3) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:38.320189 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39532e-c28c-4e51-827d-4662e3518f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.321640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39532e-c28c-4e51-827d-4662e3518f0f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.328491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 420/839] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/role_assignments?user.id=52aeb75345ed40a4a6f16e9e409e4aa3&scope.project.id=a549f5d333b1439bb186341cf516fbb0&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:40.480272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c208-a905-4fe1-ae9f-ce9feb00a18c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.480811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c208-a905-4fe1-ae9f-ce9feb00a18c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.480811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c208-a905-4fe1-ae9f-ce9feb00a18c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.482105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 420/840] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:40.487644 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326da8c-ef3c-4121-8af5-38a4d35c00de None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.488100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326da8c-ef3c-4121-8af5-38a4d35c00de None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.488190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326da8c-ef3c-4121-8af5-38a4d35c00de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.506689 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b326da8c-ef3c-4121-8af5-38a4d35c00de None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:40.507873 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b326da8c-ef3c-4121-8af5-38a4d35c00de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:40.549536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:40.574588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 421/841] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:40.844348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c208-a905-4fe1-ae9f-ce9feb00a18c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:40.904049 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:40.945057 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c208-a905-4fe1-ae9f-ce9feb00a18c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:40.978419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaae1f1-5cf9-4260-9b08-f6584c175dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:40.979148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaae1f1-5cf9-4260-9b08-f6584c175dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.979440 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaae1f1-5cf9-4260-9b08-f6584c175dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.979715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaae1f1-5cf9-4260-9b08-f6584c175dc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.980863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaae1f1-5cf9-4260-9b08-f6584c175dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:40.982297 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaae1f1-5cf9-4260-9b08-f6584c175dc0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:40.983860 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 421/842] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:40.989658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326da8c-ef3c-4121-8af5-38a4d35c00de None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:41.085209 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326da8c-ef3c-4121-8af5-38a4d35c00de None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:41.119054 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda8f9b-f0b0-4e2f-b80b-b359e5165275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:41.119580 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda8f9b-f0b0-4e2f-b80b-b359e5165275 None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.120426 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda8f9b-f0b0-4e2f-b80b-b359e5165275 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.120794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda8f9b-f0b0-4e2f-b80b-b359e5165275 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.121454 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda8f9b-f0b0-4e2f-b80b-b359e5165275 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:41.122875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda8f9b-f0b0-4e2f-b80b-b359e5165275 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:41.143449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 422/843] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:40 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:43.322624 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33080-476d-4248-a08d-b1874e7c7626 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.323181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33080-476d-4248-a08d-b1874e7c7626 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.323640 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33080-476d-4248-a08d-b1874e7c7626 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.325306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 422/844] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:43.334212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa57d-808a-4973-8522-61c47887160b None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.334985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa57d-808a-4973-8522-61c47887160b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.335449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa57d-808a-4973-8522-61c47887160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.365070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-dfeaa57d-808a-4973-8522-61c47887160b None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:43.366974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-dfeaa57d-808a-4973-8522-61c47887160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:43.406830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.450536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 423/845] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:43.721331 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a33080-476d-4248-a08d-b1874e7c7626 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.822060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a33080-476d-4248-a08d-b1874e7c7626 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.848627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.857302 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.857938 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.858213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.858482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] PATH_INFO: `/v3/roles/f2f3c5ec3295469bbeae5d990f1a59ae` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.859903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] RBAC: Authorizing `identity:get_role(role_id=f2f3c5ec3295469bbeae5d990f1a59ae)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:43.861312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:43.862635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 423/846] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/roles/f2f3c5ec3295469bbeae5d990f1a59ae => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:43.868826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaa57d-808a-4973-8522-61c47887160b None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.966543 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaa57d-808a-4973-8522-61c47887160b None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.000769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.001314 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.001596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.003003 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] PATH_INFO: `/v3/users/0a5b89e2b3cc4c47918bd9764cd3d9e1` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.015598 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5b89e2b3cc4c47918bd9764cd3d9e1)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.017100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.018768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 424/847] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/users/0a5b89e2b3cc4c47918bd9764cd3d9e1 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:44.024682 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.124105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba8f60-91e4-4f8d-8de9-e7cf84211631 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.157408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7e1c7-770d-4957-a36a-ce6d96acbe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.158053 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e1c7-770d-4957-a36a-ce6d96acbe59 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.158330 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e1c7-770d-4957-a36a-ce6d96acbe59 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.158602 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e1c7-770d-4957-a36a-ce6d96acbe59 None admin] PATH_INFO: `/v3/projects/a549f5d333b1439bb186341cf516fbb0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.159780 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7e1c7-770d-4957-a36a-ce6d96acbe59 None admin] RBAC: Authorizing `identity:get_project(project_id=a549f5d333b1439bb186341cf516fbb0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.161289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7e1c7-770d-4957-a36a-ce6d96acbe59 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.163005 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 424/848] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/projects/a549f5d333b1439bb186341cf516fbb0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:44.170141 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.193441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.278125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce67ae-7291-42bb-a8ba-e91dd58c85c1 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.313904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7312e-480b-4488-973d-c4e6ef368a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.314577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7312e-480b-4488-973d-c4e6ef368a3b None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.314861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7312e-480b-4488-973d-c4e6ef368a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.315138 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7312e-480b-4488-973d-c4e6ef368a3b None admin] PATH_INFO: `/v3/projects/a549f5d333b1439bb186341cf516fbb0/users/0a5b89e2b3cc4c47918bd9764cd3d9e1/roles/f2f3c5ec3295469bbeae5d990f1a59ae` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.317317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7312e-480b-4488-973d-c4e6ef368a3b None admin] RBAC: Authorizing `identity:create_grant(project_id=a549f5d333b1439bb186341cf516fbb0, user_id=0a5b89e2b3cc4c47918bd9764cd3d9e1, role_id=f2f3c5ec3295469bbeae5d990f1a59ae)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.318768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7312e-480b-4488-973d-c4e6ef368a3b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.336043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 425/849] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:44 2022] PUT /identity/v3/projects/a549f5d333b1439bb186341cf516fbb0/users/0a5b89e2b3cc4c47918bd9764cd3d9e1/roles/f2f3c5ec3295469bbeae5d990f1a59ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:46.492614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93903773-758e-45a4-9110-14f2b98c9272 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:46.493164 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93903773-758e-45a4-9110-14f2b98c9272 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:46.493164 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93903773-758e-45a4-9110-14f2b98c9272 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:46.494416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 425/850] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:46.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c820a-422e-45a5-b9f4-15d2d8ebfb37 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:46.500438 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c820a-422e-45a5-b9f4-15d2d8ebfb37 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:46.500568 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c820a-422e-45a5-b9f4-15d2d8ebfb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:46.519038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-f37c820a-422e-45a5-b9f4-15d2d8ebfb37 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:46.520221 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-f37c820a-422e-45a5-b9f4-15d2d8ebfb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:46.585501 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 426/851] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:46.861003 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93903773-758e-45a4-9110-14f2b98c9272 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:46.922842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:46.960475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93903773-758e-45a4-9110-14f2b98c9272 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:46.994179 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:46.994866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:46.995147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:46.995424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] PATH_INFO: `/v3/roles/f2f3c5ec3295469bbeae5d990f1a59ae` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:46.996850 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] RBAC: Authorizing `identity:get_role(role_id=f2f3c5ec3295469bbeae5d990f1a59ae)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:46.998234 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:46.999569 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 426/852] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:46 2022] GET /identity/v3/roles/f2f3c5ec3295469bbeae5d990f1a59ae => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:47.005746 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c820a-422e-45a5-b9f4-15d2d8ebfb37 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:47.018030 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:47.113819 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c820a-422e-45a5-b9f4-15d2d8ebfb37 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:47.148927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:47.149580 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:47.149860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:47.150132 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] PATH_INFO: `/v3/users/0a5b89e2b3cc4c47918bd9764cd3d9e1` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:47.152002 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5b89e2b3cc4c47918bd9764cd3d9e1)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:47.153375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:47.155044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 427/853] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:47 2022] GET /identity/v3/users/0a5b89e2b3cc4c47918bd9764cd3d9e1 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:47.161099 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:47.264782 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ea26-4432-4acb-b6f1-656bd4c7288b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:47.292881 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:47.298098 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:47.298704 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:47.298981 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:47.299251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:47.363752 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:47.365291 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:47.462675 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 427/854] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:45:47.468692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:47.547860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:47.570089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b09ae-bbf9-4919-bd3a-5c793c883817 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:47.603678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49838d7c-3590-4ace-9c58-2e09c8da5f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:47.604913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49838d7c-3590-4ace-9c58-2e09c8da5f31 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:47.605200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49838d7c-3590-4ace-9c58-2e09c8da5f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:47.605473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49838d7c-3590-4ace-9c58-2e09c8da5f31 None admin] PATH_INFO: `/v3/projects/a549f5d333b1439bb186341cf516fbb0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:47.606600 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49838d7c-3590-4ace-9c58-2e09c8da5f31 None admin] RBAC: Authorizing `identity:get_project(project_id=a549f5d333b1439bb186341cf516fbb0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:47.608039 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49838d7c-3590-4ace-9c58-2e09c8da5f31 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:47.609689 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 428/855] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:47 2022] GET /identity/v3/projects/a549f5d333b1439bb186341cf516fbb0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:47.616057 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:47.644867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:47.712801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6aee8-0944-434d-8063-9f965330ea6c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:47.746686 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef95d57-b5df-4ebc-91e9-deaf7a2adb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:47.747286 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95d57-b5df-4ebc-91e9-deaf7a2adb15 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:47.747569 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95d57-b5df-4ebc-91e9-deaf7a2adb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:47.747845 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95d57-b5df-4ebc-91e9-deaf7a2adb15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:47.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef95d57-b5df-4ebc-91e9-deaf7a2adb15 None admin] RBAC: Adding query filter params (role.id=f2f3c5ec3295469bbeae5d990f1a59ae, scope.project.id=a549f5d333b1439bb186341cf516fbb0, user.id=0a5b89e2b3cc4c47918bd9764cd3d9e1) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:47.748924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef95d57-b5df-4ebc-91e9-deaf7a2adb15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:47.750349 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef95d57-b5df-4ebc-91e9-deaf7a2adb15 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:47.756133 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 428/856] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:47 2022] GET /identity/v3/role_assignments?user.id=0a5b89e2b3cc4c47918bd9764cd3d9e1&scope.project.id=a549f5d333b1439bb186341cf516fbb0&role.id=f2f3c5ec3295469bbeae5d990f1a59ae => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:49.922250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff38f5-5bb7-4819-b804-82d2d89bd2b9 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.922836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff38f5-5bb7-4819-b804-82d2d89bd2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.922836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff38f5-5bb7-4819-b804-82d2d89bd2b9 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.924158 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 429/857] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:49.930207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f84e-98be-466c-bda8-2966d24cd05b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.930755 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f84e-98be-466c-bda8-2966d24cd05b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.930755 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f84e-98be-466c-bda8-2966d24cd05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.950792 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fa23f84e-98be-466c-bda8-2966d24cd05b None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:49.952017 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fa23f84e-98be-466c-bda8-2966d24cd05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:50.023695 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 429/858] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:50.293277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff38f5-5bb7-4819-b804-82d2d89bd2b9 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:50.393566 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff38f5-5bb7-4819-b804-82d2d89bd2b9 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:50.427127 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c3397-6b2b-4f02-8f4b-92b7344a197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:50.427750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c3397-6b2b-4f02-8f4b-92b7344a197b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:50.428031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c3397-6b2b-4f02-8f4b-92b7344a197b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:50.428307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c3397-6b2b-4f02-8f4b-92b7344a197b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:50.429456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c3397-6b2b-4f02-8f4b-92b7344a197b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:50.430896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c3397-6b2b-4f02-8f4b-92b7344a197b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:50.432633 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 430/859] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:50.438540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f84e-98be-466c-bda8-2966d24cd05b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:50.465908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:50.537115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f84e-98be-466c-bda8-2966d24cd05b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:50.570168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7955a-114e-4918-9087-d8facf2e1e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:50.570776 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7955a-114e-4918-9087-d8facf2e1e32 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:50.571056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7955a-114e-4918-9087-d8facf2e1e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:50.571328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7955a-114e-4918-9087-d8facf2e1e32 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:50.572013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7955a-114e-4918-9087-d8facf2e1e32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:50.573625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7955a-114e-4918-9087-d8facf2e1e32 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:50.601193 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 430/860] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:50 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:52.798521 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afd53-0314-4502-809c-18c24ce74523 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.799066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afd53-0314-4502-809c-18c24ce74523 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.799066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afd53-0314-4502-809c-18c24ce74523 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.800449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 431/861] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:52.805685 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d2e23-6615-4679-b501-9d6745416f17 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.806125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d2e23-6615-4679-b501-9d6745416f17 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.806218 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d2e23-6615-4679-b501-9d6745416f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.826299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-959d2e23-6615-4679-b501-9d6745416f17 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:52.827494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-959d2e23-6615-4679-b501-9d6745416f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:52.895516 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 431/862] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:53.166900 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3afd53-0314-4502-809c-18c24ce74523 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.182328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.277112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3afd53-0314-4502-809c-18c24ce74523 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.312383 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bb0c9-6b5b-46ea-9c2b-254e98910bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.313030 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bb0c9-6b5b-46ea-9c2b-254e98910bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.313315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bb0c9-6b5b-46ea-9c2b-254e98910bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.313592 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bb0c9-6b5b-46ea-9c2b-254e98910bc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.314748 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bb0c9-6b5b-46ea-9c2b-254e98910bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.316217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bb0c9-6b5b-46ea-9c2b-254e98910bc0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.317866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 432/863] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:53.324433 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d2e23-6615-4679-b501-9d6745416f17 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.335222 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.424038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d2e23-6615-4679-b501-9d6745416f17 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.457379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd33aa-d870-4234-8eba-b08c4c37bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.457978 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd33aa-d870-4234-8eba-b08c4c37bc25 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.458256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd33aa-d870-4234-8eba-b08c4c37bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.458527 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd33aa-d870-4234-8eba-b08c4c37bc25 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.459174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd33aa-d870-4234-8eba-b08c4c37bc25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.460887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd33aa-d870-4234-8eba-b08c4c37bc25 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.482233 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 432/864] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:53 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:55.684810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09499a6-bbaa-4274-898d-44068272d6e7 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.685348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09499a6-bbaa-4274-898d-44068272d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.685348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09499a6-bbaa-4274-898d-44068272d6e7 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.686684 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 433/865] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:55.691799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f8af-fe19-4171-a6bb-260b1bac1f7d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.692224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f8af-fe19-4171-a6bb-260b1bac1f7d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.692378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f8af-fe19-4171-a6bb-260b1bac1f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.711358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-efb6f8af-fe19-4171-a6bb-260b1bac1f7d None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:55.712590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-efb6f8af-fe19-4171-a6bb-260b1bac1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:55.771138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.781234 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 433/866] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:56.051670 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09499a6-bbaa-4274-898d-44068272d6e7 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.133460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.153536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09499a6-bbaa-4274-898d-44068272d6e7 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.188165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.188814 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.189089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.189361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.199588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:56.204439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:56.205781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:45:56.206735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 434/867] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:56.211922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f8af-fe19-4171-a6bb-260b1bac1f7d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.311780 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f8af-fe19-4171-a6bb-260b1bac1f7d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.345404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.346011 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.346297 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.346575 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.347248 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:56.347552 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.348963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.357669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 434/868] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:56.364772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.465642 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d138-b276-4d09-88a7-0cfa62c9ef3f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.503508 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.504128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.504432 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.504709 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] PATH_INFO: `/v3/users/5f4827de019e4cda8c7f20e080a54ff0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.518413 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.521252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] RBAC: Authorizing `identity:get_user(user_id=5f4827de019e4cda8c7f20e080a54ff0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.523239 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.525171 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 435/869] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/users/5f4827de019e4cda8c7f20e080a54ff0 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:56.531422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.587052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.630605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bedf1-4567-44cd-9d72-8825ce177fbd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.663637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d7d5f-44b5-42a0-a528-5f47b41839bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.664265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7d5f-44b5-42a0-a528-5f47b41839bf None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.664574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7d5f-44b5-42a0-a528-5f47b41839bf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.664848 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7d5f-44b5-42a0-a528-5f47b41839bf None admin] PATH_INFO: `/v3/projects/114356c945e740449e280f59318f43b4` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.665955 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d7d5f-44b5-42a0-a528-5f47b41839bf None admin] RBAC: Authorizing `identity:get_project(project_id=114356c945e740449e280f59318f43b4)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.668015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d7d5f-44b5-42a0-a528-5f47b41839bf None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.669692 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 435/870] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/projects/114356c945e740449e280f59318f43b4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:56.675656 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.772997 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329760f-ca0c-4c67-84bd-6a22685d03e7 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.810523 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56e0d-0840-43b7-b574-f84245554795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.811184 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56e0d-0840-43b7-b574-f84245554795 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.811460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56e0d-0840-43b7-b574-f84245554795 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.811733 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56e0d-0840-43b7-b574-f84245554795 None admin] PATH_INFO: `/v3/projects/114356c945e740449e280f59318f43b4/users/5f4827de019e4cda8c7f20e080a54ff0/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.813731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56e0d-0840-43b7-b574-f84245554795 None admin] RBAC: Authorizing `identity:create_grant(project_id=114356c945e740449e280f59318f43b4, user_id=5f4827de019e4cda8c7f20e080a54ff0, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.815207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56e0d-0840-43b7-b574-f84245554795 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.829606 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 436/871] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:56 2022] PUT /identity/v3/projects/114356c945e740449e280f59318f43b4/users/5f4827de019e4cda8c7f20e080a54ff0/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:58.961073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80e346-2060-4fbd-8cef-9f60bacf2439 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.961618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80e346-2060-4fbd-8cef-9f60bacf2439 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.961618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80e346-2060-4fbd-8cef-9f60bacf2439 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.962969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 436/872] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:58.968347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f22a5-9b0c-4d2d-96e6-a90a8af59c90 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.968830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f22a5-9b0c-4d2d-96e6-a90a8af59c90 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.968943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f22a5-9b0c-4d2d-96e6-a90a8af59c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.986766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-431f22a5-9b0c-4d2d-96e6-a90a8af59c90 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:58.987946 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-431f22a5-9b0c-4d2d-96e6-a90a8af59c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:59.042083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.054893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 437/873] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:45:59.323536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80e346-2060-4fbd-8cef-9f60bacf2439 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.422254 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80e346-2060-4fbd-8cef-9f60bacf2439 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.444905 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.457170 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.457801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.458076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.458349 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.469537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:59.474546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:59.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:45:59.476973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 437/874] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:59.482356 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f22a5-9b0c-4d2d-96e6-a90a8af59c90 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.587444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f22a5-9b0c-4d2d-96e6-a90a8af59c90 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.623355 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.623978 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.624257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.624579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.625268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:59.625555 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.627009 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:59.636082 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 438/875] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:59.642350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.744212 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f0376-5bca-461e-90c4-f786798a4a86 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.776714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.777340 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.777618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.777888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] PATH_INFO: `/v3/users/5f4827de019e4cda8c7f20e080a54ff0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.779009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] RBAC: Authorizing `identity:get_user(user_id=5f4827de019e4cda8c7f20e080a54ff0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.780469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:59.782035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 438/876] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/users/5f4827de019e4cda8c7f20e080a54ff0 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:59.787891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.841521 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.888837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105224f-7027-4b39-adee-badf19191c81 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.921770 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.922366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.922643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.922912 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.988382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.989833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.039548 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.085592 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 439/877] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:00.092269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.143411 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.190078 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112add5-0a40-4391-88e0-dfeaf6985b5d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.224717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b745426-781b-4403-9100-aa79a02da7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.225360 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745426-781b-4403-9100-aa79a02da7fd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.225639 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745426-781b-4403-9100-aa79a02da7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.225908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745426-781b-4403-9100-aa79a02da7fd None admin] PATH_INFO: `/v3/projects/114356c945e740449e280f59318f43b4` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.227015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b745426-781b-4403-9100-aa79a02da7fd None admin] RBAC: Authorizing `identity:get_project(project_id=114356c945e740449e280f59318f43b4)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.228644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b745426-781b-4403-9100-aa79a02da7fd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.230251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 439/878] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/projects/114356c945e740449e280f59318f43b4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:00.236338 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.333893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1b9fb-477e-41aa-8a98-2967f9c766bd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.366760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3e09-2ff3-418a-9cc7-c84d1c0195b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.367352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3e09-2ff3-418a-9cc7-c84d1c0195b7 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.367627 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3e09-2ff3-418a-9cc7-c84d1c0195b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.367898 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3e09-2ff3-418a-9cc7-c84d1c0195b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.368640 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3e09-2ff3-418a-9cc7-c84d1c0195b7 None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=114356c945e740449e280f59318f43b4, user.id=5f4827de019e4cda8c7f20e080a54ff0) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:00.369460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3e09-2ff3-418a-9cc7-c84d1c0195b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.370881 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3e09-2ff3-418a-9cc7-c84d1c0195b7 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.376432 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 440/879] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/role_assignments?user.id=5f4827de019e4cda8c7f20e080a54ff0&scope.project.id=114356c945e740449e280f59318f43b4&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:02.537490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de759-6a6b-4760-ab60-8b02eb90791f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.538048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de759-6a6b-4760-ab60-8b02eb90791f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.538048 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de759-6a6b-4760-ab60-8b02eb90791f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.539314 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 440/880] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:02.545843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0d46b-1cfc-4da3-81f4-f99a9ff3a34d None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.546363 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0d46b-1cfc-4da3-81f4-f99a9ff3a34d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.546363 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0d46b-1cfc-4da3-81f4-f99a9ff3a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.567079 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-4fd0d46b-1cfc-4da3-81f4-f99a9ff3a34d None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:02.568464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4fd0d46b-1cfc-4da3-81f4-f99a9ff3a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:02.580757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.640414 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 441/881] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:02.907503 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de759-6a6b-4760-ab60-8b02eb90791f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.008775 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de759-6a6b-4760-ab60-8b02eb90791f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.029844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.044562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe6646-506a-4a13-8dec-5dade69ddd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.045170 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe6646-506a-4a13-8dec-5dade69ddd1d None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.045450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe6646-506a-4a13-8dec-5dade69ddd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.045721 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe6646-506a-4a13-8dec-5dade69ddd1d None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.046403 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe6646-506a-4a13-8dec-5dade69ddd1d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.047767 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe6646-506a-4a13-8dec-5dade69ddd1d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.063837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 441/882] 10.222.0.23 () {60 vars in 1138 bytes} [Sun Oct 16 00:46:02 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:05.302053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a0a9-96d2-4e8c-9ff3-74b6f25854bf None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.302658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a0a9-96d2-4e8c-9ff3-74b6f25854bf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.302762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a0a9-96d2-4e8c-9ff3-74b6f25854bf None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.304085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 442/883] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:05.310314 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5ac0-606b-42df-b29b-eb7ea0b43831 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.310772 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5ac0-606b-42df-b29b-eb7ea0b43831 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.310884 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5ac0-606b-42df-b29b-eb7ea0b43831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.329243 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ba1d5ac0-606b-42df-b29b-eb7ea0b43831 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:05.330504 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ba1d5ac0-606b-42df-b29b-eb7ea0b43831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:05.401969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 442/884] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:05.670749 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a0a9-96d2-4e8c-9ff3-74b6f25854bf None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.776722 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a0a9-96d2-4e8c-9ff3-74b6f25854bf None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.811971 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c808133-1e02-40be-93d3-3d16a35d74b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.812681 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c808133-1e02-40be-93d3-3d16a35d74b0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.812969 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c808133-1e02-40be-93d3-3d16a35d74b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.813280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c808133-1e02-40be-93d3-3d16a35d74b0 None admin] PATH_INFO: `/v3/domains/6a6c72b5de5645a0afb15aa04080d041` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.824799 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c808133-1e02-40be-93d3-3d16a35d74b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a6c72b5de5645a0afb15aa04080d041)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.826319 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c808133-1e02-40be-93d3-3d16a35d74b0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.827938 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 443/885] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/domains/6a6c72b5de5645a0afb15aa04080d041 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:05.833806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5ac0-606b-42df-b29b-eb7ea0b43831 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.932252 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5ac0-606b-42df-b29b-eb7ea0b43831 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.942588 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.967856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3149c-85ea-4ddd-b29d-084805bab0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.968489 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3149c-85ea-4ddd-b29d-084805bab0ab None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.968771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3149c-85ea-4ddd-b29d-084805bab0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.969042 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3149c-85ea-4ddd-b29d-084805bab0ab None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.969690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3149c-85ea-4ddd-b29d-084805bab0ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.971123 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3149c-85ea-4ddd-b29d-084805bab0ab None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.996333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 443/886] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:05 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:08.174887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec09598-a00a-4c6f-a096-23b366c2555b None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.175492 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec09598-a00a-4c6f-a096-23b366c2555b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.175492 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec09598-a00a-4c6f-a096-23b366c2555b None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.176786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 444/887] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:08.182749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2de4b-5cdb-4d39-96ad-b0ae0a849bce None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.183231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2de4b-5cdb-4d39-96ad-b0ae0a849bce None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.183389 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2de4b-5cdb-4d39-96ad-b0ae0a849bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.202196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-67e2de4b-5cdb-4d39-96ad-b0ae0a849bce None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:08.203381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-67e2de4b-5cdb-4d39-96ad-b0ae0a849bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:08.271498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 444/888] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:08.541095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec09598-a00a-4c6f-a096-23b366c2555b None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.550565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.652946 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec09598-a00a-4c6f-a096-23b366c2555b None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.688928 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defdf4e-f809-48c2-b15e-c5e69d57c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.689550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defdf4e-f809-48c2-b15e-c5e69d57c808 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.689829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defdf4e-f809-48c2-b15e-c5e69d57c808 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.690094 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defdf4e-f809-48c2-b15e-c5e69d57c808 None admin] PATH_INFO: `/v3/domains/6a6c72b5de5645a0afb15aa04080d041` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.691201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defdf4e-f809-48c2-b15e-c5e69d57c808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a6c72b5de5645a0afb15aa04080d041)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.692661 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defdf4e-f809-48c2-b15e-c5e69d57c808 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.694249 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 445/889] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/domains/6a6c72b5de5645a0afb15aa04080d041 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:08.701077 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2de4b-5cdb-4d39-96ad-b0ae0a849bce None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.796985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.807556 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2de4b-5cdb-4d39-96ad-b0ae0a849bce None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.843985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49f0e4-435b-4b38-8894-294afe04fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.844780 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49f0e4-435b-4b38-8894-294afe04fea3 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.845063 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49f0e4-435b-4b38-8894-294afe04fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.845339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49f0e4-435b-4b38-8894-294afe04fea3 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.846025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49f0e4-435b-4b38-8894-294afe04fea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.847489 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49f0e4-435b-4b38-8894-294afe04fea3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.873807 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 445/890] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:46:08 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:11.064767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5cb86-6d79-4a7c-bfb8-395625182938 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.065347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5cb86-6d79-4a7c-bfb8-395625182938 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.065347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5cb86-6d79-4a7c-bfb8-395625182938 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.066634 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 446/891] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:11.071775 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98afbe6-08ae-42cd-a940-868c09235387 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.072228 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98afbe6-08ae-42cd-a940-868c09235387 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.072357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98afbe6-08ae-42cd-a940-868c09235387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.090821 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d98afbe6-08ae-42cd-a940-868c09235387 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:11.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d98afbe6-08ae-42cd-a940-868c09235387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:11.156031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 446/892] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:11.424812 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5cb86-6d79-4a7c-bfb8-395625182938 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.502829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.529611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5cb86-6d79-4a7c-bfb8-395625182938 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.563297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.563918 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.564196 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.564497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.575268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:11.580059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:11.581298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:46:11.582379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 447/893] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:11.587696 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98afbe6-08ae-42cd-a940-868c09235387 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.665305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.687964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98afbe6-08ae-42cd-a940-868c09235387 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.722072 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.722675 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.722953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.723226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.723879 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:11.724180 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.725572 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.733957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 447/894] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:11.739868 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.843317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55f9d-941d-4208-84a1-b7f09dc00c8a None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.876779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.877403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.877688 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.877963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] PATH_INFO: `/v3/users/68e2cb1123b646cc92887f0a47498146` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.879843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.894023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] RBAC: Authorizing `identity:get_user(user_id=68e2cb1123b646cc92887f0a47498146)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.895483 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.897180 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 448/895] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/users/68e2cb1123b646cc92887f0a47498146 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:11.903239 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.002604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a3279-70b9-4f59-ab13-607d1d2724b5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.036036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d2a70-599c-4b08-a9dd-9e6f847af331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.036703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2a70-599c-4b08-a9dd-9e6f847af331 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.036973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2a70-599c-4b08-a9dd-9e6f847af331 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.037247 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2a70-599c-4b08-a9dd-9e6f847af331 None admin] PATH_INFO: `/v3/projects/4e08fae3b37843eba45fef51e940c93c` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.038369 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d2a70-599c-4b08-a9dd-9e6f847af331 None admin] RBAC: Authorizing `identity:get_project(project_id=4e08fae3b37843eba45fef51e940c93c)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.039796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d2a70-599c-4b08-a9dd-9e6f847af331 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.042469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 448/896] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/projects/4e08fae3b37843eba45fef51e940c93c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:12.048437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.148409 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1110-5a1f-44a7-af00-bc4b36553985 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.182264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c62cdf-d6ec-4d4d-9530-f8ecc87e950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.182911 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c62cdf-d6ec-4d4d-9530-f8ecc87e950f None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.183190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c62cdf-d6ec-4d4d-9530-f8ecc87e950f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.183486 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c62cdf-d6ec-4d4d-9530-f8ecc87e950f None admin] PATH_INFO: `/v3/projects/4e08fae3b37843eba45fef51e940c93c/users/68e2cb1123b646cc92887f0a47498146/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.185458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c62cdf-d6ec-4d4d-9530-f8ecc87e950f None admin] RBAC: Authorizing `identity:create_grant(project_id=4e08fae3b37843eba45fef51e940c93c, user_id=68e2cb1123b646cc92887f0a47498146, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.186883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c62cdf-d6ec-4d4d-9530-f8ecc87e950f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.200502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 449/897] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:12 2022] PUT /identity/v3/projects/4e08fae3b37843eba45fef51e940c93c/users/68e2cb1123b646cc92887f0a47498146/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:14.402550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd721b4-752c-4444-8407-b56808aca12e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.403097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd721b4-752c-4444-8407-b56808aca12e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.403097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd721b4-752c-4444-8407-b56808aca12e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.404476 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 449/898] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:14.410127 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e925-b4f5-4031-bff2-1fd24976d6b9 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.410618 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e925-b4f5-4031-bff2-1fd24976d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.410721 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e925-b4f5-4031-bff2-1fd24976d6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.429584 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-48d0e925-b4f5-4031-bff2-1fd24976d6b9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:14.430786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-48d0e925-b4f5-4031-bff2-1fd24976d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:14.478882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.499024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 450/899] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:14.770339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd721b4-752c-4444-8407-b56808aca12e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.783378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.877179 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd721b4-752c-4444-8407-b56808aca12e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.910764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.911400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.911680 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.911952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.922549 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:14.927444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:14.928456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:46:14.929299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 450/900] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:14.935340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e925-b4f5-4031-bff2-1fd24976d6b9 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.031634 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e925-b4f5-4031-bff2-1fd24976d6b9 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.064875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.065476 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.065753 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.066025 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.066683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:15.066984 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.068359 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.076451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 451/901] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:15.082472 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.147949 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.183882 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab349-796b-4fb8-84ed-051ee8111bd3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.218270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.218899 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.219184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.219462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] PATH_INFO: `/v3/users/68e2cb1123b646cc92887f0a47498146` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.220671 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] RBAC: Authorizing `identity:get_user(user_id=68e2cb1123b646cc92887f0a47498146)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.222138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.223763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 451/902] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/users/68e2cb1123b646cc92887f0a47498146 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:15.231216 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.293625 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.352444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b4925-39f2-499a-9fa2-7576670b2c7f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.390042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.390683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.390963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.391244 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.465070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.466536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.516337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.575813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 452/903] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:15.581996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.690261 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa8a6-1b9e-42dc-a69a-41e8f6f25f77 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.726394 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9bbdb-1a70-4b19-91e2-ae03913dffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.727060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bbdb-1a70-4b19-91e2-ae03913dffa1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.727368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bbdb-1a70-4b19-91e2-ae03913dffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.727669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bbdb-1a70-4b19-91e2-ae03913dffa1 None admin] PATH_INFO: `/v3/projects/4e08fae3b37843eba45fef51e940c93c` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.728948 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9bbdb-1a70-4b19-91e2-ae03913dffa1 None admin] RBAC: Authorizing `identity:get_project(project_id=4e08fae3b37843eba45fef51e940c93c)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.730563 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9bbdb-1a70-4b19-91e2-ae03913dffa1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 452/904] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/projects/4e08fae3b37843eba45fef51e940c93c => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:15.741473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.845941 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b60f-0150-4480-9f73-ec81e667afe1 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.881470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a3a13-0874-465f-a1e6-4a088b065e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.882071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a3a13-0874-465f-a1e6-4a088b065e2f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.882345 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a3a13-0874-465f-a1e6-4a088b065e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.882613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a3a13-0874-465f-a1e6-4a088b065e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.883324 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a3a13-0874-465f-a1e6-4a088b065e2f None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=4e08fae3b37843eba45fef51e940c93c, user.id=68e2cb1123b646cc92887f0a47498146) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:15.883630 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a3a13-0874-465f-a1e6-4a088b065e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.885636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a3a13-0874-465f-a1e6-4a088b065e2f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.891960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 453/905] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/role_assignments?user.id=68e2cb1123b646cc92887f0a47498146&scope.project.id=4e08fae3b37843eba45fef51e940c93c&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:25.721877 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:25.889144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=96 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:14.041406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd41384-86ff-4ff0-aaa8-72cced6aa675 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:14.042134 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd41384-86ff-4ff0-aaa8-72cced6aa675 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:14.042250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd41384-86ff-4ff0-aaa8-72cced6aa675 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:14.043883 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 453/906] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:47:14.050306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4624-8d50-4ecc-8033-5f1f092eca01 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:14.051168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4624-8d50-4ecc-8033-5f1f092eca01 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:14.051168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4624-8d50-4ecc-8033-5f1f092eca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:14.074489 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-83cd4624-8d50-4ecc-8033-5f1f092eca01 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:14.075903 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-83cd4624-8d50-4ecc-8033-5f1f092eca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:14.178953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 454/907] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:14.517431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd41384-86ff-4ff0-aaa8-72cced6aa675 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:14.708881 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd41384-86ff-4ff0-aaa8-72cced6aa675 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:14.796204 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:14.797369 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:14.797873 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:14.798378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:14.818493 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:14.822341 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:14.846964 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:14.848753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:14.850103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:14.850103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:14.850103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:14.850103 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 454/908] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:47:14.864372 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd4624-8d50-4ecc-8033-5f1f092eca01 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:15.055646 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd4624-8d50-4ecc-8033-5f1f092eca01 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:15.106225 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:15.115399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cbfd7-df99-4939-9792-535303be2866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:15.117785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cbfd7-df99-4939-9792-535303be2866 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:15.118535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cbfd7-df99-4939-9792-535303be2866 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:15.118934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cbfd7-df99-4939-9792-535303be2866 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:15.119979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cbfd7-df99-4939-9792-535303be2866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:15.120583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cbfd7-df99-4939-9792-535303be2866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:15.123190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cbfd7-df99-4939-9792-535303be2866 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:15.152636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 455/909] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:15.156174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:15.260105 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:15.341812 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8f0e-8057-4414-8012-a17359828b1f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:15.399286 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577abad-0263-41b8-ad74-cb2041470f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:15.400069 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577abad-0263-41b8-ad74-cb2041470f80 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:15.400468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577abad-0263-41b8-ad74-cb2041470f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:15.400753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577abad-0263-41b8-ad74-cb2041470f80 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:15.401507 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577abad-0263-41b8-ad74-cb2041470f80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:15.403343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577abad-0263-41b8-ad74-cb2041470f80 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:15.440746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 455/910] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 16 00:47:15 2022] POST /identity/v3/users => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:18.048610 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7c0d-5649-4885-aaf8-0a9d38210bfa None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:18.049192 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7c0d-5649-4885-aaf8-0a9d38210bfa None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:18.049308 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7c0d-5649-4885-aaf8-0a9d38210bfa None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:18.051255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 456/911] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:47:18.061347 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151fb5-de6d-4df2-bea6-0f320adcfef1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:18.061937 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151fb5-de6d-4df2-bea6-0f320adcfef1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:18.062344 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151fb5-de6d-4df2-bea6-0f320adcfef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:18.095606 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-11151fb5-de6d-4df2-bea6-0f320adcfef1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:18.097792 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-11151fb5-de6d-4df2-bea6-0f320adcfef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:18.195763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 456/912] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:18.495734 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7c0d-5649-4885-aaf8-0a9d38210bfa None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:18.652994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7c0d-5649-4885-aaf8-0a9d38210bfa None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:18.727883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:18.729707 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:18.730315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:18.731315 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:18.749638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:18.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:18.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:18.758669 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 457/913] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:47:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:18.764253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151fb5-de6d-4df2-bea6-0f320adcfef1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:18.831801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:18.932738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151fb5-de6d-4df2-bea6-0f320adcfef1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:18.983562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:18.983562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:18.983562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:18.983562 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:18.984357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:18.984357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:18.985148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:19.004483 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 457/914] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:19.007961 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:19.095435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:19.187116 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c656d-fbaf-46ce-9ea8-5f9278a546ad None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:19.239467 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:19.240584 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:19.241037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:19.241555 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:19.258096 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:19.259560 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:19.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:19.281654 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:19.282716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:19.282716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:19.282716 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:19.287433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 458/915] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:47:19.296167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:19.448720 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:19.452277 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6a4a-247e-40b7-9c49-c26b4057a52c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:19.501466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:19.502250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:19.502577 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:19.502987 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:19.503677 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:19.504147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:19.506238 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:19.528458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 458/916] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:19.533632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:19.668276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce34c-f892-446f-a2ce-04450b7934a0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:19.670356 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:19.724011 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:19.724695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:19.724984 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:19.725336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:19.734588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:19.736066 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:47:19.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:19.752306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:19.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 459/917] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:19.758117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:19.900070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cb970-cf27-4da7-8691-b27da5ea9d3a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:19.942703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:19.943723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:19.945526 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:19.945934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:19.950450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:19.950450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:19.950450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:19.976374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 459/918] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 16 00:47:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:19.983336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:20.146561 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a30d0-bb25-4a5e-9d8f-a94fec798238 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:20.217289 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:20.217962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:20.218321 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:20.218712 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:20.235641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:20.237664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:20.254896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:20.256185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:20.258085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:20.258085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:20.258085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:20.258085 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 460/919] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:47:20.267265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:20.299523 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:20.440733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c513a-1728-4039-bbfe-115cfd7b26f3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:20.481651 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:20.482827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:20.483339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:20.483885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:20.484733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:20.485298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:20.487329 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:20.508399 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 460/920] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:20.510549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:20.533339 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:20.664983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f547cf-ed67-4812-9644-6828a06ee849 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:20.741264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:20.743291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:20.743835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:20.744713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:20.760562 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:20.763060 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:47:20.792910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:20.794353 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:20.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 461/921] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:20.808142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:20.932227 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:20.991851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72b9cd-9eec-48e3-8eb4-4ca5f64f1b0b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:21.058605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493861b8-b025-423d-8daf-8f3751498f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:21.059523 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493861b8-b025-423d-8daf-8f3751498f92 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:21.059936 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493861b8-b025-423d-8daf-8f3751498f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:21.060295 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493861b8-b025-423d-8daf-8f3751498f92 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:21.061286 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493861b8-b025-423d-8daf-8f3751498f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:21.061921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493861b8-b025-423d-8daf-8f3751498f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:21.064748 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493861b8-b025-423d-8daf-8f3751498f92 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:21.083631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 461/922] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:21.091368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:21.203364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:21.255103 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cc885-f0ce-4334-ba2a-767e5d4c66fc None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:21.309549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff588f-bbda-48d0-8070-42fa69b027a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:21.310311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff588f-bbda-48d0-8070-42fa69b027a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:21.311503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff588f-bbda-48d0-8070-42fa69b027a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:21.311503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff588f-bbda-48d0-8070-42fa69b027a2 None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/b2981a8784a642f2945ed41d32112100/roles/06e0d6417d76496f94940bc5222eb2b9` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:21.330584 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff588f-bbda-48d0-8070-42fa69b027a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=b2981a8784a642f2945ed41d32112100, role_id=06e0d6417d76496f94940bc5222eb2b9)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:21.332088 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff588f-bbda-48d0-8070-42fa69b027a2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:21.347357 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 462/923] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:47:21 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/b2981a8784a642f2945ed41d32112100/roles/06e0d6417d76496f94940bc5222eb2b9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:47:23.633868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6476-80a2-47ac-b02c-43afc9ade2f4 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:23.634547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6476-80a2-47ac-b02c-43afc9ade2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:23.634547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6476-80a2-47ac-b02c-43afc9ade2f4 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:23.635917 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 462/924] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:23.642604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd97ec-f101-46e2-b566-766e58a5539e None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:23.643399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd97ec-f101-46e2-b566-766e58a5539e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:23.643399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd97ec-f101-46e2-b566-766e58a5539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:23.667286 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-3fcd97ec-f101-46e2-b566-766e58a5539e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:23.669004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-3fcd97ec-f101-46e2-b566-766e58a5539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:23.763766 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 463/925] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:24.123788 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6476-80a2-47ac-b02c-43afc9ade2f4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:24.253621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6476-80a2-47ac-b02c-43afc9ade2f4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:24.304790 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:24.305559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.305809 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.306161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.314224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:24.318805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:24.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:24.328793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:24.329826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 463/926] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 16 00:47:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:47:24.333088 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd97ec-f101-46e2-b566-766e58a5539e None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:24.403004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:24.464920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd97ec-f101-46e2-b566-766e58a5539e None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:24.506165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:24.507318 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.507594 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.507913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.508755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] RBAC: Adding query filter params (name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:24.509063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:24.510537 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:24.519933 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 464/927] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 16 00:47:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:24.526944 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:24.670037 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d46a7-da17-41bd-9a88-b5e7330b4c09 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:24.712730 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:24.713540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.713990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.714310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.729508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:24.731635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:24.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:24.752242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:24.753786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:24.753786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:24.753786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:24.753786 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 464/928] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:24.758406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:24.880608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196456-afe7-4447-8566-749ec6071f0f None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:24.900437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:24.929511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:24.930496 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.931008 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.931499 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.932397 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:24.932845 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:24.934777 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:24.952815 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 465/929] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:24.962799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:25.039421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:25.102480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4151-796c-4ffb-af7e-5acf3ae464f6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:25.152991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:25.154221 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:25.154959 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:25.155764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:25.167327 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:25.168802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:47:25.191537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:25.192991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:25.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 465/930] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:25.200427 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:25.331680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696af3-2213-4352-afb7-8e6b07689c49 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:25.378028 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:25.378708 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:25.379069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:25.379218 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:25.379911 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:25.380203 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:25.381917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:25.407563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 466/931] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 16 00:47:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:25.415184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:25.557950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc57954-115d-482b-a309-ddc68e870596 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:25.576008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:25.607110 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:25.607763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:25.608111 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:25.608457 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:25.707783 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:25.709552 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:25.843408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 466/932] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:47:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:47:25.845063 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:25.890954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:25.968583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7e78-55bb-4363-9c17-0136f1613b23 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:26.011950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:26.012725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:26.013043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:26.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:26.025271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:26.026828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:26.044680 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:26.046457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:26.048271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:26.048271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:26.048271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:26.048271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 467/933] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:26.057449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:26.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:26.189618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a189-1f6b-4a90-86e3-b483ec0b5b33 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:26.232504 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:26.233132 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:26.233416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:26.233688 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:26.234341 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:26.234650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:26.236193 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:26.254988 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 467/934] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:26.261394 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:26.374127 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:26.395285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919bee-d56d-41b8-84de-5e3248b4cfe0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:26.434844 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:26.435500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:26.435755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:26.436024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:26.443801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:26.445258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:47:26.460588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:26.461982 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:26.463061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:26.468147 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 468/935] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:47:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:26.468302 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:26.558026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:26.613004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8609fe5-794d-41a7-b4c5-3048a89ff666 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:26.665208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cac75-96e8-402a-bdb4-1fc82c35fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:26.666042 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cac75-96e8-402a-bdb4-1fc82c35fa63 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:26.666547 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cac75-96e8-402a-bdb4-1fc82c35fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:26.667005 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cac75-96e8-402a-bdb4-1fc82c35fa63 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:26.668074 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cac75-96e8-402a-bdb4-1fc82c35fa63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:26.668541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cac75-96e8-402a-bdb4-1fc82c35fa63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:26.670539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cac75-96e8-402a-bdb4-1fc82c35fa63 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:26.688223 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 468/936] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:47:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:26.696437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:26.829392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185df35-a865-4a52-b005-b93ed7baae5c None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:26.887821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7abc10-64f0-4f51-932e-f72e3bd91128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:26.888591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7abc10-64f0-4f51-932e-f72e3bd91128 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:26.889034 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7abc10-64f0-4f51-932e-f72e3bd91128 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:26.889382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7abc10-64f0-4f51-932e-f72e3bd91128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:26.890378 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7abc10-64f0-4f51-932e-f72e3bd91128 None admin] RBAC: Adding query filter params (role.id=06e0d6417d76496f94940bc5222eb2b9, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=b2981a8784a642f2945ed41d32112100) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:26.890749 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7abc10-64f0-4f51-932e-f72e3bd91128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:26.892494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7abc10-64f0-4f51-932e-f72e3bd91128 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:26.900255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 469/937] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:47:26 2022] GET /identity/v3/role_assignments?user.id=b2981a8784a642f2945ed41d32112100&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=06e0d6417d76496f94940bc5222eb2b9 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:29.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66b14-83cc-41b3-8882-69e54c80c13e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:29.735617 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66b14-83cc-41b3-8882-69e54c80c13e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:29.735617 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66b14-83cc-41b3-8882-69e54c80c13e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:29.736941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 469/938] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:29.743288 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef5ff-bca4-4946-8694-6221b4504a08 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:29.743781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef5ff-bca4-4946-8694-6221b4504a08 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:29.743894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef5ff-bca4-4946-8694-6221b4504a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:29.766448 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-460ef5ff-bca4-4946-8694-6221b4504a08 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:29.767907 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-460ef5ff-bca4-4946-8694-6221b4504a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:29.771479 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:29.870273 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 470/939] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:47:30.196705 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66b14-83cc-41b3-8882-69e54c80c13e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:30.344405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66b14-83cc-41b3-8882-69e54c80c13e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:30.386593 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:30.398879 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:30.399914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:30.400272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:30.400714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:30.414395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:30.419480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:30.420844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:30.421866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 470/940] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:47:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:30.428059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ef5ff-bca4-4946-8694-6221b4504a08 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:30.588253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ef5ff-bca4-4946-8694-6221b4504a08 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:30.645187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:30.645949 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:30.646514 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:30.646998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:30.648125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:30.648589 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:30.650388 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:30.663080 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 471/941] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:30.670331 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:30.802405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b0b5-c915-4845-9d41-f16fc120f5f9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:30.858021 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:30.858825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:30.859139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:30.859482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:30.875197 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:30.877238 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:30.898586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:30.899774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:30.900827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:30.900827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:30.900827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:30.900827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 471/942] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:30.906458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:30.909683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.037810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcb29f-0eaf-4e41-a45d-774d12be0222 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.086105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.086725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.087007 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.087279 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.087928 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:31.088230 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.089641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.103016 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 472/943] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:31.109873 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.169804 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.250004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af16d6-904d-4597-a44a-8d6713e4adb2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.299803 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.300692 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.301130 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.301538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.318262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.321897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:47:31.340715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:31.341996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:31.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 472/944] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:31.350821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.431405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.494381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5cdb-da04-4418-befd-f8a1a687fb8b None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.544051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.545003 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.545436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.545922 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.546855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:31.547366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.549176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.577699 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 473/945] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:31.577932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.729368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dbdc5-c409-4af5-b72b-b80d359c445d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.731111 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.770730 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.771376 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.772256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.772590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.783289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.784790 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:31.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:31.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:31.805458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:31.805458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:31.805458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:31.805458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 473/946] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:31.809572 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.961238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877e358-b730-400e-bd41-269ff7a56e4d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.995881 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:32.024717 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:32.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:32.025853 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:32.026167 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:32.027122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:32.027576 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:32.029223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:32.045665 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 474/947] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:32.054000 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:32.191266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e5335-f21d-4f33-b68f-e2157d6d2eed None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:32.239681 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:32.240925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:32.241854 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:32.242104 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:32.249792 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:32.251597 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:47:32.266015 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:32.267269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:32.268168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 474/948] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:32.275513 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:32.410203 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b5117-3d68-405c-8b7a-9c1f9f78b350 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:32.469652 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87b530-36fe-4f78-936a-bf2fb06c25f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:32.470238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b530-36fe-4f78-936a-bf2fb06c25f0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:32.470521 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b530-36fe-4f78-936a-bf2fb06c25f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:32.470794 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b530-36fe-4f78-936a-bf2fb06c25f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:32.471517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87b530-36fe-4f78-936a-bf2fb06c25f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:32.471823 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87b530-36fe-4f78-936a-bf2fb06c25f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:32.473350 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87b530-36fe-4f78-936a-bf2fb06c25f0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:32.487614 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 475/949] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:32.494827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:32.515805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:32.638738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4104c-b758-4467-b1e3-7ebbc1664c0d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:32.691305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a1f32-3eff-4997-843f-74cd71556cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:32.692055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1f32-3eff-4997-843f-74cd71556cba None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:32.692405 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1f32-3eff-4997-843f-74cd71556cba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:32.692700 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1f32-3eff-4997-843f-74cd71556cba None admin] PATH_INFO: `/v3/projects/caa359a8225241c9a4322ed6c105402c/users/b2981a8784a642f2945ed41d32112100/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:32.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a1f32-3eff-4997-843f-74cd71556cba None admin] RBAC: Authorizing `identity:create_grant(project_id=caa359a8225241c9a4322ed6c105402c, user_id=b2981a8784a642f2945ed41d32112100, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:32.697144 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a1f32-3eff-4997-843f-74cd71556cba None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:32.712632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 475/950] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 16 00:47:32 2022] PUT /identity/v3/projects/caa359a8225241c9a4322ed6c105402c/users/b2981a8784a642f2945ed41d32112100/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:47:35.058820 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca151f-125e-450c-8677-e81c86279e37 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.059422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca151f-125e-450c-8677-e81c86279e37 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.059958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca151f-125e-450c-8677-e81c86279e37 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:35.062365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 476/951] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:35.070702 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256bee-424d-442d-aba5-382d1462e821 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.071291 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256bee-424d-442d-aba5-382d1462e821 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.071774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256bee-424d-442d-aba5-382d1462e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:35.104929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-71256bee-424d-442d-aba5-382d1462e821 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:35.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-71256bee-424d-442d-aba5-382d1462e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:35.211380 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 476/952] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:35.488023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca151f-125e-450c-8677-e81c86279e37 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:35.541149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:35.625810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca151f-125e-450c-8677-e81c86279e37 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:35.672712 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:35.673456 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.673817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.674083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:35.690215 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:35.696533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:35.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:35.700280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 477/953] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 16 00:47:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:35.704610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256bee-424d-442d-aba5-382d1462e821 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:35.708034 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:35.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256bee-424d-442d-aba5-382d1462e821 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:35.900972 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:35.901604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.901886 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.903326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:35.903326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:35.903326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:35.904712 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:35.914816 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 477/954] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 16 00:47:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:35.921125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:36.051413 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:36.054812 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d32b63-339f-42ad-927f-916deed2a1cd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:36.099177 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:36.100551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:36.100854 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:36.101132 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:36.113826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:36.116537 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:36.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:36.135133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:36.136159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:36.136159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:36.136159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:36.136159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 478/955] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:36.141543 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:36.220415 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:36.269316 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203320-6ee8-4e70-b991-e03bca2d204a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:36.322790 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:36.323449 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:36.323722 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:36.323960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:36.324678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:36.324948 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:36.326326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:36.340611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 478/956] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:36.347010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:36.490361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454801ca-0e24-4a78-91aa-4a7c44c526ad None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:36.532785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:36.533542 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:36.533817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:36.534110 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:36.543328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:36.544878 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:47:36.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:36.561687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:36.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 479/957] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:47:36.567625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:36.698787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64ed88-25b5-467c-917d-e43aa4bfc295 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:36.735793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:36.747372 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:36.748124 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:36.748555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:36.749028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:36.750071 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:36.750626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:36.752567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:36.780399 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 479/958] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 16 00:47:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:36.787012 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:36.806149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:36.917918 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1f08c-6c45-4b12-934d-db686317dda0 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:36.955117 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:36.955958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:36.956244 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:36.956551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:37.032348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:37.033765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:37.048396 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:37.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 480/959] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 16 00:47:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:47:37.151723 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:37.261343 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90602-d5f3-4588-ba29-dfd02ff6901d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:37.298490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:37.299133 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:37.299425 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:37.299697 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:37.310561 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:37.312027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:47:37.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:37.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:47:37.330789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:47:37.330789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:47:37.330789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:37.330789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 480/960] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:37.336122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:37.448787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad6b79-1da2-417d-8b5e-559d4b478fdd None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:37.463711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:37.487048 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:37.487723 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:37.487993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:37.488331 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:37.489044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:37.489388 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:37.491071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:37.503403 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 481/961] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 16 00:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:37.509711 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:37.549535 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:37.618650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee71ab-e9f1-42f7-bc7f-759f71d78f45 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:37.656535 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:37.657184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:37.657470 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:37.657743 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:37.666686 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:37.668292 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:47:37.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:37.684749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: ERROR keystone.server.flask.application Oct 16 00:47:37.685952 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 481/962] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 16 00:47:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:37.692336 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:37.814511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2091956-f0ee-45ec-93d2-67fac9e31fe2 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:37.860745 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e9042-5387-4935-89d7-284a1d3296dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:37.861749 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e9042-5387-4935-89d7-284a1d3296dc None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:37.862176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e9042-5387-4935-89d7-284a1d3296dc None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:37.862504 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e9042-5387-4935-89d7-284a1d3296dc None admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:37.863361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e9042-5387-4935-89d7-284a1d3296dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:37.863747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e9042-5387-4935-89d7-284a1d3296dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:37.865895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e9042-5387-4935-89d7-284a1d3296dc None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:37.880245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 482/963] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 16 00:47:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:37.887258 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:37.994148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:38.000728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581302-10bd-4138-9a2a-95b7451f5e52 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:38.039262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49c321-d783-4a0d-904b-d520f521bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:38.039894 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c321-d783-4a0d-904b-d520f521bc79 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:38.040178 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c321-d783-4a0d-904b-d520f521bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:38.040492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c321-d783-4a0d-904b-d520f521bc79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:38.041253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49c321-d783-4a0d-904b-d520f521bc79 None admin] RBAC: Adding query filter params (role.id=9622bc515e36436ba412f5f88df3dcf0, scope.project.id=caa359a8225241c9a4322ed6c105402c, user.id=b2981a8784a642f2945ed41d32112100) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:38.041567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49c321-d783-4a0d-904b-d520f521bc79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:38.043057 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49c321-d783-4a0d-904b-d520f521bc79 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:38.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 482/964] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 16 00:47:37 2022] GET /identity/v3/role_assignments?user.id=b2981a8784a642f2945ed41d32112100&scope.project.id=caa359a8225241c9a4322ed6c105402c&role.id=9622bc515e36436ba412f5f88df3dcf0 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:40.262436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27a32a-5e2e-47de-841d-f984ade1053a None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:40.262978 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27a32a-5e2e-47de-841d-f984ade1053a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:40.262978 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27a32a-5e2e-47de-841d-f984ade1053a None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:40.264302 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 483/965] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:40.269716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e9d9f-b011-427a-b830-c2e452b24cff None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:40.270126 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e9d9f-b011-427a-b830-c2e452b24cff None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:40.270265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e9d9f-b011-427a-b830-c2e452b24cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:40.288624 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-436e9d9f-b011-427a-b830-c2e452b24cff None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:40.289796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-436e9d9f-b011-427a-b830-c2e452b24cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:40.353650 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 483/966] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:40.621054 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27a32a-5e2e-47de-841d-f984ade1053a None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:40.655291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:40.730109 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27a32a-5e2e-47de-841d-f984ade1053a None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:40.762949 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:40.763574 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:40.763853 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:40.764119 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:40.764732 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:40.766093 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:40.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:40.776760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:40.777829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 484/967] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:47:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:40.782611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e9d9f-b011-427a-b830-c2e452b24cff None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:40.872337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:40.882200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e9d9f-b011-427a-b830-c2e452b24cff None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:40.914679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ab82b-7862-417e-b5cf-1715c891befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:40.915279 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ab82b-7862-417e-b5cf-1715c891befa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:40.915555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ab82b-7862-417e-b5cf-1715c891befa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:40.915825 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ab82b-7862-417e-b5cf-1715c891befa None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:40.916487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ab82b-7862-417e-b5cf-1715c891befa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:40.916791 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ab82b-7862-417e-b5cf-1715c891befa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:40.918139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ab82b-7862-417e-b5cf-1715c891befa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:40.922751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 484/968] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 16 00:47:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:40.928828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:41.022412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:41.028588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093944c-7406-4867-b4d3-28b7414a5a8d None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:41.062059 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f5398-1845-4f98-83fc-a0be689dd1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:41.062657 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f5398-1845-4f98-83fc-a0be689dd1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:41.062935 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f5398-1845-4f98-83fc-a0be689dd1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:41.063206 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f5398-1845-4f98-83fc-a0be689dd1e6 None admin] PATH_INFO: `/v3/services` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:41.063824 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f5398-1845-4f98-83fc-a0be689dd1e6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:41.064125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f5398-1845-4f98-83fc-a0be689dd1e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:41.065528 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f5398-1845-4f98-83fc-a0be689dd1e6 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:41.069942 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 485/969] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 16 00:47:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:43.252326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20b2c-a101-4386-aa32-89afa6d829ef None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:43.252811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20b2c-a101-4386-aa32-89afa6d829ef None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:43.252907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20b2c-a101-4386-aa32-89afa6d829ef None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:43.254236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 485/970] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:43.260485 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7617386-1470-4b91-8dae-a01049fcfb5a None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:43.261209 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7617386-1470-4b91-8dae-a01049fcfb5a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:43.261209 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7617386-1470-4b91-8dae-a01049fcfb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:43.281483 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-e7617386-1470-4b91-8dae-a01049fcfb5a None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:43.282683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e7617386-1470-4b91-8dae-a01049fcfb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:43.348415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 486/971] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:43.614837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b20b2c-a101-4386-aa32-89afa6d829ef None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:43.722047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b20b2c-a101-4386-aa32-89afa6d829ef None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:43.754725 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69926c-03b8-4ce5-b590-553fb683c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:43.755324 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69926c-03b8-4ce5-b590-553fb683c24a None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:43.755641 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69926c-03b8-4ce5-b590-553fb683c24a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:43.755908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69926c-03b8-4ce5-b590-553fb683c24a None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:43.756586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69926c-03b8-4ce5-b590-553fb683c24a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:43.757941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69926c-03b8-4ce5-b590-553fb683c24a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:43.772524 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 486/972] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 16 00:47:43 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:45.977043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9f368-5b46-458a-aa53-e4b56ddb29da None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:45.977585 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9f368-5b46-458a-aa53-e4b56ddb29da None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:45.977679 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9f368-5b46-458a-aa53-e4b56ddb29da None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:45.978979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 487/973] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:45.984208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f700-d12b-48ea-90b8-fd7a742d9a57 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:45.984659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f700-d12b-48ea-90b8-fd7a742d9a57 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:45.984798 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f700-d12b-48ea-90b8-fd7a742d9a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:46.003109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7138f700-d12b-48ea-90b8-fd7a742d9a57 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:46.004303 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7138f700-d12b-48ea-90b8-fd7a742d9a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:46.014196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:46.078396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 487/974] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:46.351210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9f368-5b46-458a-aa53-e4b56ddb29da None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:46.440673 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:46.451494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9f368-5b46-458a-aa53-e4b56ddb29da None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:46.485351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:46.485976 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:46.486253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:46.486525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:46.487105 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:46.488500 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:46.497979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:46.500518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:46.501726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 488/975] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:47:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:46.505212 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f700-d12b-48ea-90b8-fd7a742d9a57 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:46.602041 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f700-d12b-48ea-90b8-fd7a742d9a57 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:46.635016 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:46.635633 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:46.635918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:46.636198 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:46.636991 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:46.637178 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:46.638559 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:46.643956 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 488/976] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 16 00:47:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:46.650724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:46.759243 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e95ff-91b0-4696-af70-9006b196d002 None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:46.791824 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b4f6-25e3-4422-87b2-f989fc6bda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:46.792440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b4f6-25e3-4422-87b2-f989fc6bda5b None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:46.792718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b4f6-25e3-4422-87b2-f989fc6bda5b None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:46.792989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b4f6-25e3-4422-87b2-f989fc6bda5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:46.793677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b4f6-25e3-4422-87b2-f989fc6bda5b None admin] RBAC: Adding query filter params (interface=public, service_id=113e4915b34c41029bc713810f4a66da, region_id=RegionOne) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:46.793985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b4f6-25e3-4422-87b2-f989fc6bda5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:46.795378 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b4f6-25e3-4422-87b2-f989fc6bda5b None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:46.800193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 489/977] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 16 00:47:46 2022] GET /identity/v3/endpoints?service_id=113e4915b34c41029bc713810f4a66da&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:46.806059 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:46.809771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:46.907496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59ead-9ca1-4c0d-844e-4f429b990d90 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:46.939596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a30afd-ced0-41d7-a88e-e3f315ce4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:46.940193 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30afd-ced0-41d7-a88e-e3f315ce4d90 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:46.940501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30afd-ced0-41d7-a88e-e3f315ce4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:46.940773 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30afd-ced0-41d7-a88e-e3f315ce4d90 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:46.941373 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a30afd-ced0-41d7-a88e-e3f315ce4d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:46.942733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a30afd-ced0-41d7-a88e-e3f315ce4d90 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:46.949836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 489/978] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 16 00:47:46 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:47:49.111271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5704f21-72e7-4570-918c-d7d61e3caad4 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.111821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5704f21-72e7-4570-918c-d7d61e3caad4 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.111821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5704f21-72e7-4570-918c-d7d61e3caad4 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.113203 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 490/979] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:49.119075 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba1d56-146a-425f-97da-358efd9e02b9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.119560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba1d56-146a-425f-97da-358efd9e02b9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.119662 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba1d56-146a-425f-97da-358efd9e02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-78ba1d56-146a-425f-97da-358efd9e02b9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:49.142703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-78ba1d56-146a-425f-97da-358efd9e02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:49.209153 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:49.215345 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 490/980] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:49.484012 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5704f21-72e7-4570-918c-d7d61e3caad4 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:49.507790 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:49.597200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5704f21-72e7-4570-918c-d7d61e3caad4 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:49.633301 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:49.634008 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.634444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.634628 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] PATH_INFO: `/v3/services/placement` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.635258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:49.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:49.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:49.649280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: ERROR keystone.server.flask.application Oct 16 00:47:49.650877 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 491/981] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 16 00:47:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:49.657729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba1d56-146a-425f-97da-358efd9e02b9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:49.777644 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba1d56-146a-425f-97da-358efd9e02b9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:49.811793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d25f2-29e0-4a5d-8df7-53b57c31215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:49.812433 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d25f2-29e0-4a5d-8df7-53b57c31215b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.812734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d25f2-29e0-4a5d-8df7-53b57c31215b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.813008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d25f2-29e0-4a5d-8df7-53b57c31215b None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.813635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d25f2-29e0-4a5d-8df7-53b57c31215b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:49.813935 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d25f2-29e0-4a5d-8df7-53b57c31215b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:49.815301 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d25f2-29e0-4a5d-8df7-53b57c31215b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:49.821282 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 491/982] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 16 00:47:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:49.827583 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:49.909806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:49.929268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693f834-078f-4289-bcc1-8c407f288eac None admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:49.962758 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201b3a6-e69d-461c-9a8f-cfbb1f40de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:49.963365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b3a6-e69d-461c-9a8f-cfbb1f40de4a None admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.963644 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b3a6-e69d-461c-9a8f-cfbb1f40de4a None admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.963915 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b3a6-e69d-461c-9a8f-cfbb1f40de4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.964616 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201b3a6-e69d-461c-9a8f-cfbb1f40de4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:49.965993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201b3a6-e69d-461c-9a8f-cfbb1f40de4a None admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:49.986572 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 492/983] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:47:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:59.817584 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=69 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:59.982226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:01.309246 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b256aa-e8f6-476b-8803-68262d7083bb None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:01.309992 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b256aa-e8f6-476b-8803-68262d7083bb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:01.310442 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b256aa-e8f6-476b-8803-68262d7083bb None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:01.312887 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 492/984] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:01.319347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed17a3f-c568-435a-82dd-aa1815c83020 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:01.320018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed17a3f-c568-435a-82dd-aa1815c83020 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:01.320018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed17a3f-c568-435a-82dd-aa1815c83020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:01.407546 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-2ed17a3f-c568-435a-82dd-aa1815c83020 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:01.409929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-2ed17a3f-c568-435a-82dd-aa1815c83020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:01.529352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 493/985] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:01.839896 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0589c-65c1-4032-a6c9-4011331778b2 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:01.840182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0589c-65c1-4032-a6c9-4011331778b2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:01.840539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0589c-65c1-4032-a6c9-4011331778b2 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:01.843627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 493/986] 10.222.0.23 () {54 vars in 964 bytes} [Sun Oct 16 00:49:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:01.850921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3cca4-2463-4d34-af25-89783e558f93 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:01.851143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3cca4-2463-4d34-af25-89783e558f93 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:01.851252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3cca4-2463-4d34-af25-89783e558f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:01.988861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-4ce3cca4-2463-4d34-af25-89783e558f93 None None] MFA Rules not processed for user `aaaeca0952f04f229b9d53ce1625a1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:01.990576 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4ce3cca4-2463-4d34-af25-89783e558f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.014314 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:02.079937 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 494/987] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 16 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:02.090328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0589c-65c1-4032-a6c9-4011331778b2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:02.092201 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-75c0589c-65c1-4032-a6c9-4011331778b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.238763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0589c-65c1-4032-a6c9-4011331778b2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:02.329473 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ad3f5-9409-4d00-b097-ecf842a738ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:02.331310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad3f5-9409-4d00-b097-ecf842a738ea service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:02.331310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad3f5-9409-4d00-b097-ecf842a738ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:02.331310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad3f5-9409-4d00-b097-ecf842a738ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:02.332968 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ed6ad3f5-9409-4d00-b097-ecf842a738ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.419700 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:02.487636 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ad3f5-9409-4d00-b097-ecf842a738ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:02.489127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ad3f5-9409-4d00-b097-ecf842a738ea service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:02.509980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 494/988] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:05.009826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055e14-0f8a-4541-800a-f1e260cdbd77 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:05.010392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055e14-0f8a-4541-800a-f1e260cdbd77 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:05.010392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055e14-0f8a-4541-800a-f1e260cdbd77 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:05.011750 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 495/989] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:05.017454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cc71a-42b1-4280-8fe4-c9494b6f7573 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:05.018470 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cc71a-42b1-4280-8fe4-c9494b6f7573 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:05.018713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cc71a-42b1-4280-8fe4-c9494b6f7573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:05.108844 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-141cc71a-42b1-4280-8fe4-c9494b6f7573 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:05.110064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-141cc71a-42b1-4280-8fe4-c9494b6f7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:05.214996 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 495/990] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:49:05.499784 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055e14-0f8a-4541-800a-f1e260cdbd77 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:05.501343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-5d055e14-0f8a-4541-800a-f1e260cdbd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:05.609005 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055e14-0f8a-4541-800a-f1e260cdbd77 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:05.687550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:05.690890 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abf1cf-7e88-4edf-b5ae-0ddc6a742460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:05.691916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abf1cf-7e88-4edf-b5ae-0ddc6a742460 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:05.692257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abf1cf-7e88-4edf-b5ae-0ddc6a742460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:05.692755 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abf1cf-7e88-4edf-b5ae-0ddc6a742460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:05.694586 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-25abf1cf-7e88-4edf-b5ae-0ddc6a742460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:05.806089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abf1cf-7e88-4edf-b5ae-0ddc6a742460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:05.807533 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abf1cf-7e88-4edf-b5ae-0ddc6a742460 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:05.826369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 496/991] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:08.373262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d23f79-530b-4b97-8a49-be726b9abaef None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:08.374139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d23f79-530b-4b97-8a49-be726b9abaef None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:08.374304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d23f79-530b-4b97-8a49-be726b9abaef None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:08.375749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 496/992] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:08.381731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e571d-87cb-4288-832f-7cf4c677eecc None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:08.382192 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e571d-87cb-4288-832f-7cf4c677eecc None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:08.382292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e571d-87cb-4288-832f-7cf4c677eecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:08.449259 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-475e571d-87cb-4288-832f-7cf4c677eecc None None] MFA Rules not processed for user `6608c88ccfcd49c99cc0f587051254fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:08.450481 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-475e571d-87cb-4288-832f-7cf4c677eecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:08.501962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:08.546392 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 497/993] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:08.834903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d23f79-530b-4b97-8a49-be726b9abaef None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:08.836870 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-56d23f79-530b-4b97-8a49-be726b9abaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:08.847692 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:08.944724 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d23f79-530b-4b97-8a49-be726b9abaef None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:09.019199 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad3d5-d897-4fa5-890b-90676493444e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:09.019815 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad3d5-d897-4fa5-890b-90676493444e service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:09.020092 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad3d5-d897-4fa5-890b-90676493444e service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:09.020390 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad3d5-d897-4fa5-890b-90676493444e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:09.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f8fad3d5-d897-4fa5-890b-90676493444e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:09.085639 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:09.133411 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad3d5-d897-4fa5-890b-90676493444e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:09.134843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad3d5-d897-4fa5-890b-90676493444e service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:09.155665 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 497/994] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:12.028148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4ac7-8638-41a9-a976-6dcedf4ebd64 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:12.028773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4ac7-8638-41a9-a976-6dcedf4ebd64 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:12.028773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4ac7-8638-41a9-a976-6dcedf4ebd64 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:12.029956 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 498/995] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:12.036835 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f42b-4cb2-4945-a851-3edf48e665e3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:12.037419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f42b-4cb2-4945-a851-3edf48e665e3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:12.037419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f42b-4cb2-4945-a851-3edf48e665e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:12.104886 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3924f42b-4cb2-4945-a851-3edf48e665e3 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:12.106094 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3924f42b-4cb2-4945-a851-3edf48e665e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:12.204768 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 498/996] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:12.497967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4ac7-8638-41a9-a976-6dcedf4ebd64 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:12.499542 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-d0ee4ac7-8638-41a9-a976-6dcedf4ebd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:12.607954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4ac7-8638-41a9-a976-6dcedf4ebd64 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:12.688194 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0d4a7-426d-4d49-8ddb-11474ecfbab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:12.688826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d4a7-426d-4d49-8ddb-11474ecfbab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:12.689110 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d4a7-426d-4d49-8ddb-11474ecfbab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:12.689498 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d4a7-426d-4d49-8ddb-11474ecfbab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:12.691427 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9ae0d4a7-426d-4d49-8ddb-11474ecfbab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:12.698602 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:12.808518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0d4a7-426d-4d49-8ddb-11474ecfbab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:12.811000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0d4a7-426d-4d49-8ddb-11474ecfbab0 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:12.840565 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 499/997] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:15.782053 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7bfb-c2d4-491c-8b3f-8a231826dc86 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:15.782653 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7bfb-c2d4-491c-8b3f-8a231826dc86 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:15.782653 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7bfb-c2d4-491c-8b3f-8a231826dc86 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:15.784839 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 499/998] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:15.790294 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8daa-fc1c-4f75-af75-80435a5230a9 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:15.790842 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8daa-fc1c-4f75-af75-80435a5230a9 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:15.790842 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8daa-fc1c-4f75-af75-80435a5230a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:15.869804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-65be8daa-fc1c-4f75-af75-80435a5230a9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:15.870950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-65be8daa-fc1c-4f75-af75-80435a5230a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:15.935970 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:15.985513 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 500/999] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:16.273102 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7bfb-c2d4-491c-8b3f-8a231826dc86 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:16.274654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c23f7bfb-c2d4-491c-8b3f-8a231826dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:16.297542 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:16.392754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7bfb-c2d4-491c-8b3f-8a231826dc86 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:16.469264 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8d2d8-af83-46a8-a22a-f571586da524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:16.469903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d2d8-af83-46a8-a22a-f571586da524 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:16.470174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d2d8-af83-46a8-a22a-f571586da524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:16.471070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d2d8-af83-46a8-a22a-f571586da524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:16.472927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0ce8d2d8-af83-46a8-a22a-f571586da524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:16.547379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:16.588694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8d2d8-af83-46a8-a22a-f571586da524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:16.590149 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8d2d8-af83-46a8-a22a-f571586da524 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:16.609763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 500/1000] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:18.902242 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8a32-8e48-4018-9ee4-d7b07f220e79 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:18.902802 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8a32-8e48-4018-9ee4-d7b07f220e79 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:18.902960 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8a32-8e48-4018-9ee4-d7b07f220e79 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:18.904406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 501/1001] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:18.910907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a0f5e-8a65-4aa6-8df4-d89e80928a22 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:18.911377 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a0f5e-8a65-4aa6-8df4-d89e80928a22 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:18.911492 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a0f5e-8a65-4aa6-8df4-d89e80928a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:18.985155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-100a0f5e-8a65-4aa6-8df4-d89e80928a22 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:18.987020 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-100a0f5e-8a65-4aa6-8df4-d89e80928a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:19.107477 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 501/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:19.389355 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb8a32-8e48-4018-9ee4-d7b07f220e79 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:19.390938 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a3eb8a32-8e48-4018-9ee4-d7b07f220e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:19.505147 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb8a32-8e48-4018-9ee4-d7b07f220e79 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:19.582386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f45618-81f8-4b54-9157-7e3a43e86bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:19.582989 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f45618-81f8-4b54-9157-7e3a43e86bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:19.583262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f45618-81f8-4b54-9157-7e3a43e86bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:19.583527 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f45618-81f8-4b54-9157-7e3a43e86bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:19.585421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-21f45618-81f8-4b54-9157-7e3a43e86bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:19.605467 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:19.719077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f45618-81f8-4b54-9157-7e3a43e86bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:19.721086 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f45618-81f8-4b54-9157-7e3a43e86bb6 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:19.741735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 502/1003] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:22.071348 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad39a91-dc34-4ade-ba2b-4d001a58d1a7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:22.071872 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad39a91-dc34-4ade-ba2b-4d001a58d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:22.071985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad39a91-dc34-4ade-ba2b-4d001a58d1a7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:22.073300 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 502/1004] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:49:22.078787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1057-8d2b-49ea-88b6-97d54da42435 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:22.079217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1057-8d2b-49ea-88b6-97d54da42435 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:22.079340 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1057-8d2b-49ea-88b6-97d54da42435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:22.151619 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-203b1057-8d2b-49ea-88b6-97d54da42435 None None] MFA Rules not processed for user `6608c88ccfcd49c99cc0f587051254fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:22.152798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-203b1057-8d2b-49ea-88b6-97d54da42435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:22.218816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:22.252768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 503/1005] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:22.543875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad39a91-dc34-4ade-ba2b-4d001a58d1a7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:22.545529 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7ad39a91-dc34-4ade-ba2b-4d001a58d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:22.581340 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:22.660619 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad39a91-dc34-4ade-ba2b-4d001a58d1a7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:22.741188 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3bb53-b4e0-4171-8460-9b9c2855762a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:22.741809 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3bb53-b4e0-4171-8460-9b9c2855762a service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:22.742090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3bb53-b4e0-4171-8460-9b9c2855762a service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:22.742365 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3bb53-b4e0-4171-8460-9b9c2855762a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:22.743986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bcd3bb53-b4e0-4171-8460-9b9c2855762a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:22.830756 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:22.867753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3bb53-b4e0-4171-8460-9b9c2855762a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:22.869452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3bb53-b4e0-4171-8460-9b9c2855762a service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:22.888338 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 503/1006] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:25.333122 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc6f5-898b-463a-8309-096048eb7191 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:25.333692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc6f5-898b-463a-8309-096048eb7191 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:25.333692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc6f5-898b-463a-8309-096048eb7191 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:25.335279 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 504/1007] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:25.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bfc5b-ef20-4756-bae0-84aff4038368 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:25.341187 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bfc5b-ef20-4756-bae0-84aff4038368 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:25.341306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bfc5b-ef20-4756-bae0-84aff4038368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:25.408920 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4b6bfc5b-ef20-4756-bae0-84aff4038368 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:25.410192 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4b6bfc5b-ef20-4756-bae0-84aff4038368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:25.509002 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 504/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:25.787925 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc6f5-898b-463a-8309-096048eb7191 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:25.789522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-d2cbc6f5-898b-463a-8309-096048eb7191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:25.901134 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc6f5-898b-463a-8309-096048eb7191 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:25.976811 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f741-932e-467a-ad00-c9b309d58ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:25.977412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f741-932e-467a-ad00-c9b309d58ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:25.977691 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f741-932e-467a-ad00-c9b309d58ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:25.977963 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f741-932e-467a-ad00-c9b309d58ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:25.979552 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b794f741-932e-467a-ad00-c9b309d58ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:26.008165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:26.094668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f741-932e-467a-ad00-c9b309d58ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:26.097236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f741-932e-467a-ad00-c9b309d58ae7 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:26.120635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 505/1009] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:28.347840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a12c-700d-4c3e-a96d-edb66e083810 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:28.348450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a12c-700d-4c3e-a96d-edb66e083810 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:28.348450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a12c-700d-4c3e-a96d-edb66e083810 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:28.349797 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 505/1010] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:28.354961 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132bd85-f223-46e5-b272-86f1141ca398 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:28.355381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132bd85-f223-46e5-b272-86f1141ca398 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:28.355512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132bd85-f223-46e5-b272-86f1141ca398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:28.422815 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b132bd85-f223-46e5-b272-86f1141ca398 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:28.425075 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b132bd85-f223-46e5-b272-86f1141ca398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:28.500573 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:28.523582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 506/1011] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:28.807905 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a12c-700d-4c3e-a96d-edb66e083810 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:28.809542 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7525a12c-700d-4c3e-a96d-edb66e083810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:28.850364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:28.914895 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a12c-700d-4c3e-a96d-edb66e083810 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:28.995270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002cb25-1cf3-4972-97c5-4be6ee33e95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:28.995885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002cb25-1cf3-4972-97c5-4be6ee33e95b service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:28.996165 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002cb25-1cf3-4972-97c5-4be6ee33e95b service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:28.996467 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002cb25-1cf3-4972-97c5-4be6ee33e95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:28.998109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5002cb25-1cf3-4972-97c5-4be6ee33e95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:29.082271 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:29.109833 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002cb25-1cf3-4972-97c5-4be6ee33e95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:29.112104 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002cb25-1cf3-4972-97c5-4be6ee33e95b service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:29.131265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 506/1012] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:31.730464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f346-ee8d-424f-b7c1-e3cfd937cd22 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:31.731009 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f346-ee8d-424f-b7c1-e3cfd937cd22 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:31.731009 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f346-ee8d-424f-b7c1-e3cfd937cd22 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:31.732420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 507/1013] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:31.738626 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dcaa9-7d69-40ed-9733-ad1072ab27fd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:31.739139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dcaa9-7d69-40ed-9733-ad1072ab27fd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:31.739234 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dcaa9-7d69-40ed-9733-ad1072ab27fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:31.807489 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-363dcaa9-7d69-40ed-9733-ad1072ab27fd None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:31.808740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-363dcaa9-7d69-40ed-9733-ad1072ab27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:31.917829 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 507/1014] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:32.214674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3f346-ee8d-424f-b7c1-e3cfd937cd22 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:32.216258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-8dc3f346-ee8d-424f-b7c1-e3cfd937cd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:32.332254 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3f346-ee8d-424f-b7c1-e3cfd937cd22 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:32.409643 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294bcaf-ca9d-4d7f-9bf0-1c8a61021152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:32.410262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294bcaf-ca9d-4d7f-9bf0-1c8a61021152 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:32.410541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294bcaf-ca9d-4d7f-9bf0-1c8a61021152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:32.410819 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294bcaf-ca9d-4d7f-9bf0-1c8a61021152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:32.412488 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e294bcaf-ca9d-4d7f-9bf0-1c8a61021152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:32.451032 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:32.529477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294bcaf-ca9d-4d7f-9bf0-1c8a61021152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:32.530825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294bcaf-ca9d-4d7f-9bf0-1c8a61021152 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:32.551107 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 508/1015] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:49:36.829136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489f75-675e-4c4b-b65c-406bf88de64a None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:36.829669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489f75-675e-4c4b-b65c-406bf88de64a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:36.829669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489f75-675e-4c4b-b65c-406bf88de64a None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:36.831142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 508/1016] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:49:36.837638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197886ea-0d32-4c92-9fe5-ad4cc182eba0 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:36.838326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197886ea-0d32-4c92-9fe5-ad4cc182eba0 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:36.838326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197886ea-0d32-4c92-9fe5-ad4cc182eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:36.911549 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-197886ea-0d32-4c92-9fe5-ad4cc182eba0 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:36.912797 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-197886ea-0d32-4c92-9fe5-ad4cc182eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:37.004215 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:37.017056 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 509/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:49:37.300476 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489f75-675e-4c4b-b65c-406bf88de64a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:37.302014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3c489f75-675e-4c4b-b65c-406bf88de64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:37.353337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:37.413320 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489f75-675e-4c4b-b65c-406bf88de64a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:37.493025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06076bc4-163f-4a08-8303-fbd0a371dbc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:37.493539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06076bc4-163f-4a08-8303-fbd0a371dbc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:37.493822 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06076bc4-163f-4a08-8303-fbd0a371dbc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:37.494100 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06076bc4-163f-4a08-8303-fbd0a371dbc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:37.495738 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-06076bc4-163f-4a08-8303-fbd0a371dbc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:37.606413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:37.627540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06076bc4-163f-4a08-8303-fbd0a371dbc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:37.629082 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06076bc4-163f-4a08-8303-fbd0a371dbc2 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:37.651151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 509/1018] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:40.622625 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bbca-5039-4bda-bf5a-b454608febdf None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:40.623265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bbca-5039-4bda-bf5a-b454608febdf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:40.623265 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bbca-5039-4bda-bf5a-b454608febdf None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:40.624588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 510/1019] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:40.630927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3431-d1b0-4982-9008-837c09bc5681 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:40.631482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3431-d1b0-4982-9008-837c09bc5681 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:40.631482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3431-d1b0-4982-9008-837c09bc5681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:40.716339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c37f3431-d1b0-4982-9008-837c09bc5681 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:40.717604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c37f3431-d1b0-4982-9008-837c09bc5681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:40.824139 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 510/1020] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:41.109074 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04bbca-5039-4bda-bf5a-b454608febdf None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:41.111210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-8d04bbca-5039-4bda-bf5a-b454608febdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:41.249605 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04bbca-5039-4bda-bf5a-b454608febdf None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:41.339098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6752746-add8-4a55-a39d-8205bd97469e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:41.339752 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752746-add8-4a55-a39d-8205bd97469e service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:41.340006 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752746-add8-4a55-a39d-8205bd97469e service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:41.340274 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752746-add8-4a55-a39d-8205bd97469e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:41.341921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-f6752746-add8-4a55-a39d-8205bd97469e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:41.389497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:41.468421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6752746-add8-4a55-a39d-8205bd97469e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:41.470483 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6752746-add8-4a55-a39d-8205bd97469e service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:41.491906 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 511/1021] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:45.882849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32feb41-ed9c-4b65-a11a-dfff60294776 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:45.883378 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32feb41-ed9c-4b65-a11a-dfff60294776 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:45.883485 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32feb41-ed9c-4b65-a11a-dfff60294776 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:45.885025 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 511/1022] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:45.890415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623982d-c7bd-4e4f-9b36-40da0bff9fae None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:45.890903 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623982d-c7bd-4e4f-9b36-40da0bff9fae None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:45.891042 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623982d-c7bd-4e4f-9b36-40da0bff9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:45.974905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-f623982d-c7bd-4e4f-9b36-40da0bff9fae None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:45.976344 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-f623982d-c7bd-4e4f-9b36-40da0bff9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:46.091269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:46.093509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 512/1023] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:46.394610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32feb41-ed9c-4b65-a11a-dfff60294776 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:46.396184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c32feb41-ed9c-4b65-a11a-dfff60294776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:46.464426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:46.515576 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32feb41-ed9c-4b65-a11a-dfff60294776 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:46.597727 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f237fab-3a2b-4db0-b12f-469d63a74c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:46.598591 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f237fab-3a2b-4db0-b12f-469d63a74c0f service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:46.599036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f237fab-3a2b-4db0-b12f-469d63a74c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:46.599412 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f237fab-3a2b-4db0-b12f-469d63a74c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:46.601117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3f237fab-3a2b-4db0-b12f-469d63a74c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:46.721646 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:46.726347 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f237fab-3a2b-4db0-b12f-469d63a74c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:46.727813 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f237fab-3a2b-4db0-b12f-469d63a74c0f service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:46.748215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 512/1024] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:53.532261 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be3a6-6124-4f92-9dae-b8575114feaf None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:53.533086 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be3a6-6124-4f92-9dae-b8575114feaf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:53.533271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be3a6-6124-4f92-9dae-b8575114feaf None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:53.536133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 513/1025] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 00:49:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:53.545610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305341a-fc8d-4cf1-a477-3d7a913e105c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:53.546385 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305341a-fc8d-4cf1-a477-3d7a913e105c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:53.546385 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305341a-fc8d-4cf1-a477-3d7a913e105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:53.780502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0305341a-fc8d-4cf1-a477-3d7a913e105c None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:53.783487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0305341a-fc8d-4cf1-a477-3d7a913e105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:54.041353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 513/1026] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:58.267488 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fa58-e0ba-46a1-8b6e-a0ed6c4629b7 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:58.268416 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fa58-e0ba-46a1-8b6e-a0ed6c4629b7 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:58.268690 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fa58-e0ba-46a1-8b6e-a0ed6c4629b7 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:58.270354 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 514/1027] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 00:49:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:58.275802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45409760-6a03-4bdf-b8c8-538d145452c2 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:58.276296 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45409760-6a03-4bdf-b8c8-538d145452c2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:58.276433 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45409760-6a03-4bdf-b8c8-538d145452c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:58.354134 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:58.388476 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-45409760-6a03-4bdf-b8c8-538d145452c2 None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:58.389720 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-45409760-6a03-4bdf-b8c8-538d145452c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:58.528213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 514/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:59.837136 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82c96-65e6-4e24-b745-9051f60a0123 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:59.837816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82c96-65e6-4e24-b745-9051f60a0123 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:59.837816 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82c96-65e6-4e24-b745-9051f60a0123 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:59.839128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 515/1029] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 00:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:49:59.846125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1b6e-2659-4f08-8530-64c2b85bf881 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:59.846908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1b6e-2659-4f08-8530-64c2b85bf881 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:59.847045 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1b6e-2659-4f08-8530-64c2b85bf881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:59.945008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-292e1b6e-2659-4f08-8530-64c2b85bf881 None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:59.946151 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-292e1b6e-2659-4f08-8530-64c2b85bf881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:59.993514 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:00.066750 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 515/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 00:49:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:03.789581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1894151-2d58-48ca-bf02-37920f811103 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:03.789581 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1894151-2d58-48ca-bf02-37920f811103 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:03.790396 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1894151-2d58-48ca-bf02-37920f811103 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:03.791879 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 516/1031] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:03.801300 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31670cd-624d-4d3f-9f71-8ee94d0393e8 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:03.801800 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31670cd-624d-4d3f-9f71-8ee94d0393e8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:03.802189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31670cd-624d-4d3f-9f71-8ee94d0393e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:03.936491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e31670cd-624d-4d3f-9f71-8ee94d0393e8 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:03.936491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e31670cd-624d-4d3f-9f71-8ee94d0393e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:04.065500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 516/1032] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:04.429377 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11be4a6-9a4d-42d8-8fee-846377dea51e None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:04.431082 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11be4a6-9a4d-42d8-8fee-846377dea51e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:04.431854 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11be4a6-9a4d-42d8-8fee-846377dea51e None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:04.436197 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 517/1033] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 16 00:50:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:04.453055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a716-a6e4-46b2-b586-6735476bd0a3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:04.453325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a716-a6e4-46b2-b586-6735476bd0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:04.453645 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a716-a6e4-46b2-b586-6735476bd0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:04.485432 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:04.595523 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ed57a716-a6e4-46b2-b586-6735476bd0a3 None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:04.597677 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ed57a716-a6e4-46b2-b586-6735476bd0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:04.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 517/1034] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 16 00:50:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:04.820783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11be4a6-9a4d-42d8-8fee-846377dea51e None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:04.822687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a11be4a6-9a4d-42d8-8fee-846377dea51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:05.112948 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11be4a6-9a4d-42d8-8fee-846377dea51e None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:05.301370 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:05.392647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec18853-6694-4170-8cde-760a35200d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:05.393838 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18853-6694-4170-8cde-760a35200d72 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:05.394452 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18853-6694-4170-8cde-760a35200d72 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:05.395083 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18853-6694-4170-8cde-760a35200d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:05.398585 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-6ec18853-6694-4170-8cde-760a35200d72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:05.552865 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec18853-6694-4170-8cde-760a35200d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:05.554687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec18853-6694-4170-8cde-760a35200d72 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:05.576603 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 518/1035] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:08.107811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9eff3-7283-40f0-a3e5-39eefe70068a None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:08.108437 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9eff3-7283-40f0-a3e5-39eefe70068a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:08.108437 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9eff3-7283-40f0-a3e5-39eefe70068a None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:08.110014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 518/1036] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:08.115915 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035874-578e-4eab-9115-9ea84234da87 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:08.116482 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035874-578e-4eab-9115-9ea84234da87 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:08.116482 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035874-578e-4eab-9115-9ea84234da87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:08.201244 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-05035874-578e-4eab-9115-9ea84234da87 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:08.204596 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-05035874-578e-4eab-9115-9ea84234da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:08.276296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:08.378337 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 519/1037] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:50:08.948277 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9eff3-7283-40f0-a3e5-39eefe70068a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:08.950130 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-56b9eff3-7283-40f0-a3e5-39eefe70068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:09.038400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:09.143607 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9eff3-7283-40f0-a3e5-39eefe70068a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:09.314862 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66ea7f-4c43-44d5-a75d-fc3a0461bb45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:09.315339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66ea7f-4c43-44d5-a75d-fc3a0461bb45 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:09.315766 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66ea7f-4c43-44d5-a75d-fc3a0461bb45 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:09.316233 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66ea7f-4c43-44d5-a75d-fc3a0461bb45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:09.319411 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-df66ea7f-4c43-44d5-a75d-fc3a0461bb45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:09.362755 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:09.442101 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66ea7f-4c43-44d5-a75d-fc3a0461bb45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:09.443852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66ea7f-4c43-44d5-a75d-fc3a0461bb45 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:09.464781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 519/1038] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:12.142840 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6084b3-985d-4a8e-8870-ec7e4c6e739f None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.143502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6084b3-985d-4a8e-8870-ec7e4c6e739f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.143502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6084b3-985d-4a8e-8870-ec7e4c6e739f None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.144991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 520/1039] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:50:12.151760 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62f644-8352-44b7-9b10-8741146f49e7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.152374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62f644-8352-44b7-9b10-8741146f49e7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.152868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62f644-8352-44b7-9b10-8741146f49e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.255774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-aa62f644-8352-44b7-9b10-8741146f49e7 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:12.257067 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-aa62f644-8352-44b7-9b10-8741146f49e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:12.378851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:12.388386 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 520/1040] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:12.693049 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45c6e-602f-436c-8b10-a1a567816088 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.693588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45c6e-602f-436c-8b10-a1a567816088 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.694045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45c6e-602f-436c-8b10-a1a567816088 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.695628 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 521/1041] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 16 00:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:12.702034 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c652da-4599-4061-88f7-02c6d4a45f1a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.702366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c652da-4599-4061-88f7-02c6d4a45f1a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.704005 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c652da-4599-4061-88f7-02c6d4a45f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.792448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-66c652da-4599-4061-88f7-02c6d4a45f1a None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:12.793716 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-66c652da-4599-4061-88f7-02c6d4a45f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:12.953310 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 521/1042] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 16 00:50:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:12.963757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45c6e-602f-436c-8b10-a1a567816088 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:12.965641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-bda45c6e-602f-436c-8b10-a1a567816088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.151616 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a7587-8fcc-49f1-8011-cd7f322f9bbf None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:13.151903 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a7587-8fcc-49f1-8011-cd7f322f9bbf None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:13.152485 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a7587-8fcc-49f1-8011-cd7f322f9bbf None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:13.153831 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 522/1043] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:50:13.160046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593fb6-95b7-44af-9fb1-66e5b2050fba None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:13.160419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593fb6-95b7-44af-9fb1-66e5b2050fba None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:13.160710 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593fb6-95b7-44af-9fb1-66e5b2050fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:13.205958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45c6e-602f-436c-8b10-a1a567816088 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:13.238875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:13.271424 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:13.275204 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-aa593fb6-95b7-44af-9fb1-66e5b2050fba None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:13.278473 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-aa593fb6-95b7-44af-9fb1-66e5b2050fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.389873 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724c00-0e05-47f8-98cf-6901faae0256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:13.391348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724c00-0e05-47f8-98cf-6901faae0256 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:13.391697 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724c00-0e05-47f8-98cf-6901faae0256 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:13.391967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724c00-0e05-47f8-98cf-6901faae0256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:13.393724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-bc724c00-0e05-47f8-98cf-6901faae0256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.417567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 523/1044] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:50:13.554582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724c00-0e05-47f8-98cf-6901faae0256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:13.556222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724c00-0e05-47f8-98cf-6901faae0256 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:13.582988 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 522/1045] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:13.731187 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58956922-f919-45e1-9a1a-22fe130666f0 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:13.731904 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58956922-f919-45e1-9a1a-22fe130666f0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:13.732458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58956922-f919-45e1-9a1a-22fe130666f0 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:13.735560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 524/1046] 10.222.0.23 () {54 vars in 963 bytes} [Sun Oct 16 00:50:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:13.742104 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2a299-0c42-4c9a-8eaa-8970ace5cad9 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:13.742446 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2a299-0c42-4c9a-8eaa-8970ace5cad9 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:13.742658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2a299-0c42-4c9a-8eaa-8970ace5cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:13.793793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:13.866300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-89c2a299-0c42-4c9a-8eaa-8970ace5cad9 None None] MFA Rules not processed for user `e94eb5478e41472abf39001b01db4ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:13.867931 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-89c2a299-0c42-4c9a-8eaa-8970ace5cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.977994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 523/1047] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 16 00:50:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:13.986393 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58956922-f919-45e1-9a1a-22fe130666f0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:13.987930 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-58956922-f919-45e1-9a1a-22fe130666f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:14.149273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58956922-f919-45e1-9a1a-22fe130666f0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:14.186736 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:14.253568 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a83da0-1244-4b60-84f7-428e01e7dc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94eb5478e41472abf39001b01db4ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:14.254176 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83da0-1244-4b60-84f7-428e01e7dc47 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:14.254462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83da0-1244-4b60-84f7-428e01e7dc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:14.254751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83da0-1244-4b60-84f7-428e01e7dc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:14.256426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-90a83da0-1244-4b60-84f7-428e01e7dc47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:14.439295 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a83da0-1244-4b60-84f7-428e01e7dc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:14.441226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a83da0-1244-4b60-84f7-428e01e7dc47 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:14.469983 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 525/1048] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:15.947747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d596-7c61-453a-8017-0ac328e248b4 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:15.948346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d596-7c61-453a-8017-0ac328e248b4 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:15.948650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d596-7c61-453a-8017-0ac328e248b4 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:15.950125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 524/1049] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:15.956389 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66555-fa81-4f69-80c4-04060de01549 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:15.957666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66555-fa81-4f69-80c4-04060de01549 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:15.957666 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66555-fa81-4f69-80c4-04060de01549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:16.031731 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6af66555-fa81-4f69-80c4-04060de01549 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:16.032990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6af66555-fa81-4f69-80c4-04060de01549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:16.040933 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:16.137819 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 526/1050] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:16.444526 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d596-7c61-453a-8017-0ac328e248b4 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:16.446173 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-0875d596-7c61-453a-8017-0ac328e248b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:16.636812 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:16.684125 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d596-7c61-453a-8017-0ac328e248b4 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:16.824895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcd483-c399-49d7-b2fb-8f079ae6d77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:16.825869 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcd483-c399-49d7-b2fb-8f079ae6d77b service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:16.826259 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcd483-c399-49d7-b2fb-8f079ae6d77b service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:16.826638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcd483-c399-49d7-b2fb-8f079ae6d77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:16.829420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4dfcd483-c399-49d7-b2fb-8f079ae6d77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:16.937496 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:16.954179 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcd483-c399-49d7-b2fb-8f079ae6d77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:16.956554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcd483-c399-49d7-b2fb-8f079ae6d77b service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:16.978885 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 525/1051] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:19.855267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1a5da-7b60-4ce0-99e0-f85b6786fa88 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:19.855854 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1a5da-7b60-4ce0-99e0-f85b6786fa88 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:19.855854 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1a5da-7b60-4ce0-99e0-f85b6786fa88 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:19.857346 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 527/1052] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:19.864423 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4d42-f785-4d09-8a1c-1a9c7fd1c787 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:19.865160 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4d42-f785-4d09-8a1c-1a9c7fd1c787 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:19.865519 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4d42-f785-4d09-8a1c-1a9c7fd1c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:19.976950 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-715b4d42-f785-4d09-8a1c-1a9c7fd1c787 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:19.979821 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-715b4d42-f785-4d09-8a1c-1a9c7fd1c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:20.173268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 526/1053] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:20.581429 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1a5da-7b60-4ce0-99e0-f85b6786fa88 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:20.584266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-53a1a5da-7b60-4ce0-99e0-f85b6786fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:20.749637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:20.761924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1a5da-7b60-4ce0-99e0-f85b6786fa88 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:20.893118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd489e57-7f2c-4eff-8cb4-d72a395e7823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:20.893867 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd489e57-7f2c-4eff-8cb4-d72a395e7823 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:20.894258 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd489e57-7f2c-4eff-8cb4-d72a395e7823 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:20.894625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd489e57-7f2c-4eff-8cb4-d72a395e7823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:20.896482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd489e57-7f2c-4eff-8cb4-d72a395e7823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:21.006202 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd489e57-7f2c-4eff-8cb4-d72a395e7823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:21.007855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd489e57-7f2c-4eff-8cb4-d72a395e7823 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:21.020792 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:21.032390 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 528/1054] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:23.361938 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d9cc-f16f-4825-9ef5-77bde8220227 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:23.362385 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d9cc-f16f-4825-9ef5-77bde8220227 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:23.362671 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d9cc-f16f-4825-9ef5-77bde8220227 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:23.364273 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 527/1055] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:50:23.370796 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3d38-d966-4f76-b1f7-8b7614127b0f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:23.371243 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3d38-d966-4f76-b1f7-8b7614127b0f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:23.371675 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3d38-d966-4f76-b1f7-8b7614127b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:23.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-cc3d3d38-d966-4f76-b1f7-8b7614127b0f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:23.447505 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cc3d3d38-d966-4f76-b1f7-8b7614127b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:23.556500 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 529/1056] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:50:23.893384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582d9cc-f16f-4825-9ef5-77bde8220227 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:23.894891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4582d9cc-f16f-4825-9ef5-77bde8220227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:23.958444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:24.055904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582d9cc-f16f-4825-9ef5-77bde8220227 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:24.193327 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa31f4-a2e7-4abc-a3ce-c4aea8b37ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:24.194016 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa31f4-a2e7-4abc-a3ce-c4aea8b37ad4 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:24.194365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa31f4-a2e7-4abc-a3ce-c4aea8b37ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:24.194676 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa31f4-a2e7-4abc-a3ce-c4aea8b37ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:24.196605 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-6ffa31f4-a2e7-4abc-a3ce-c4aea8b37ad4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:24.220524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:24.306764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa31f4-a2e7-4abc-a3ce-c4aea8b37ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:24.308658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa31f4-a2e7-4abc-a3ce-c4aea8b37ad4 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:24.329706 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 528/1057] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:26.954835 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e92e-7dd4-4a15-b69a-40be850c1d06 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:26.955369 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e92e-7dd4-4a15-b69a-40be850c1d06 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:26.955369 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e92e-7dd4-4a15-b69a-40be850c1d06 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:26.957404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 530/1058] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:50:26.964185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e74db-170d-4335-87af-82e7a6968c14 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:26.964833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e74db-170d-4335-87af-82e7a6968c14 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:26.965000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e74db-170d-4335-87af-82e7a6968c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:27.074438 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-4d7e74db-170d-4335-87af-82e7a6968c14 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:27.075700 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4d7e74db-170d-4335-87af-82e7a6968c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:27.208937 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:27.216786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 529/1059] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:27.513596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e92e-7dd4-4a15-b69a-40be850c1d06 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:27.515961 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e434e92e-7dd4-4a15-b69a-40be850c1d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:27.607818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:27.697186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e92e-7dd4-4a15-b69a-40be850c1d06 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:27.835315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ce121-d61e-488d-bd07-16bfaf1015c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:27.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce121-d61e-488d-bd07-16bfaf1015c9 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:27.836927 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce121-d61e-488d-bd07-16bfaf1015c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:27.837237 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce121-d61e-488d-bd07-16bfaf1015c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:27.839209 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e29ce121-d61e-488d-bd07-16bfaf1015c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:27.891352 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:27.960775 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce121-d61e-488d-bd07-16bfaf1015c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:27.962757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce121-d61e-488d-bd07-16bfaf1015c9 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:27.986893 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 531/1060] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:30.283979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e4ce-8fb3-46d8-b7f5-29527a8d03dd None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:30.284569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e4ce-8fb3-46d8-b7f5-29527a8d03dd None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:30.284744 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e4ce-8fb3-46d8-b7f5-29527a8d03dd None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:30.286443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 530/1061] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:30.293008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ddf4-b8d1-45c2-9d8d-92cff173e5f1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:30.294001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ddf4-b8d1-45c2-9d8d-92cff173e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:30.294001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ddf4-b8d1-45c2-9d8d-92cff173e5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:30.388119 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6d36ddf4-b8d1-45c2-9d8d-92cff173e5f1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:30.389746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6d36ddf4-b8d1-45c2-9d8d-92cff173e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:30.534773 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 532/1062] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:50:30.895256 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086e4ce-8fb3-46d8-b7f5-29527a8d03dd None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:30.896913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1086e4ce-8fb3-46d8-b7f5-29527a8d03dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:31.123071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086e4ce-8fb3-46d8-b7f5-29527a8d03dd None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:31.229898 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:31.284078 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2733267-e7f4-4da3-a3f4-94ecb03475bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:31.285155 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733267-e7f4-4da3-a3f4-94ecb03475bb service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:31.285155 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733267-e7f4-4da3-a3f4-94ecb03475bb service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:31.285474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733267-e7f4-4da3-a3f4-94ecb03475bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:31.286866 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a2733267-e7f4-4da3-a3f4-94ecb03475bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:31.396175 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2733267-e7f4-4da3-a3f4-94ecb03475bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:31.398052 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2733267-e7f4-4da3-a3f4-94ecb03475bb service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:31.422440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 531/1063] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:33.410179 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f9c8-d1ac-40ab-b452-e127562d5d80 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.410769 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f9c8-d1ac-40ab-b452-e127562d5d80 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.410769 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f9c8-d1ac-40ab-b452-e127562d5d80 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.412703 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 533/1064] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:33.422138 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbb3d-23e6-4d74-8d28-f2ec0c283bb3 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.422979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbb3d-23e6-4d74-8d28-f2ec0c283bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.422979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbb3d-23e6-4d74-8d28-f2ec0c283bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.503329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-e46bbb3d-23e6-4d74-8d28-f2ec0c283bb3 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:33.504509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e46bbb3d-23e6-4d74-8d28-f2ec0c283bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:33.540517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:33.615280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 532/1065] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:33.759484 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429165-c394-4d04-929f-e6bf8b1785a1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.759771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429165-c394-4d04-929f-e6bf8b1785a1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.759961 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429165-c394-4d04-929f-e6bf8b1785a1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.761325 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 534/1066] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:50:33.768557 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.768846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.769124 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.849449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:33.850653 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:33.944458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba8b5-fb38-4656-8c84-8813cb4392b5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.944746 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba8b5-fb38-4656-8c84-8813cb4392b5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.945065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba8b5-fb38-4656-8c84-8813cb4392b5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.946630 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 535/1067] 10.222.0.23 () {54 vars in 962 bytes} [Sun Oct 16 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:50:33.952789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.953097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.953314 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.963026 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 533/1068] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:33.971809 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:34.043548 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] MFA Rules not processed for user `18da5473168d4998bb38de305174819c`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:34.045050 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:34.164120 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 536/1069] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 16 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:34.181187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:34.182757 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:34.210461 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:34.276450 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:34.277685 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:34.322258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a889-6a48-4a50-9ac1-0b7d54369be0 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:34.410047 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:34.419817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c6d7d-8349-4ca6-a901-a45cbf5d9a01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18da5473168d4998bb38de305174819c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:34.421205 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c6d7d-8349-4ca6-a901-a45cbf5d9a01 service glance] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:34.421493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c6d7d-8349-4ca6-a901-a45cbf5d9a01 service glance] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:34.421767 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c6d7d-8349-4ca6-a901-a45cbf5d9a01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:34.423448 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-2d2c6d7d-8349-4ca6-a901-a45cbf5d9a01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:34.426701 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880ab2d-8afa-4afb-ac08-03faec840a2a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:34.546509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:34.575879 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763a949-6c48-42f8-9509-c62ee392ca75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:34.576468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763a949-6c48-42f8-9509-c62ee392ca75 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:34.576763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763a949-6c48-42f8-9509-c62ee392ca75 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:34.577091 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763a949-6c48-42f8-9509-c62ee392ca75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:34.579158 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1763a949-6c48-42f8-9509-c62ee392ca75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:34.602263 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c6d7d-8349-4ca6-a901-a45cbf5d9a01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:34.604769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c6d7d-8349-4ca6-a901-a45cbf5d9a01 service glance] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:34.635037 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 534/1070] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:34.698635 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763a949-6c48-42f8-9509-c62ee392ca75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:34.700251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763a949-6c48-42f8-9509-c62ee392ca75 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:34.712227 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:34.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 537/1071] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:35.455016 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955ee7-d2a1-4297-a9a9-c4b829ea2b70 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:35.455655 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955ee7-d2a1-4297-a9a9-c4b829ea2b70 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:35.455961 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955ee7-d2a1-4297-a9a9-c4b829ea2b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:35.557683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-96955ee7-d2a1-4297-a9a9-c4b829ea2b70 None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:35.558939 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-96955ee7-d2a1-4297-a9a9-c4b829ea2b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:35.691351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 535/1072] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:50:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:35.750670 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ea4-927e-49cd-8e87-7e2320307ca2 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:35.751558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ea4-927e-49cd-8e87-7e2320307ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:35.751838 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ea4-927e-49cd-8e87-7e2320307ca2 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:35.753274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 538/1073] 10.222.0.23 () {54 vars in 943 bytes} [Sun Oct 16 00:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:35.761408 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05566b9e-4d7c-488f-8629-52227f2dc01e None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:35.761899 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05566b9e-4d7c-488f-8629-52227f2dc01e None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:35.762424 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05566b9e-4d7c-488f-8629-52227f2dc01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:35.848084 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:35.874891 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-05566b9e-4d7c-488f-8629-52227f2dc01e None None] MFA Rules not processed for user `ad81ce2fa0644dae929e51279b7f9b76`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:35.876178 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-05566b9e-4d7c-488f-8629-52227f2dc01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:35.997279 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 536/1074] 10.222.0.23 () {58 vars in 1040 bytes} [Sun Oct 16 00:50:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:36.011023 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284ea4-927e-49cd-8e87-7e2320307ca2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:36.012790 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7c284ea4-927e-49cd-8e87-7e2320307ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:36.172824 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284ea4-927e-49cd-8e87-7e2320307ca2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:36.267091 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:36.292706 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac2a89-4817-4227-a04f-638055901854 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:36.293321 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2a89-4817-4227-a04f-638055901854 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:36.293597 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2a89-4817-4227-a04f-638055901854 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:36.293868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2a89-4817-4227-a04f-638055901854 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:36.295694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-04ac2a89-4817-4227-a04f-638055901854 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:36.413808 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac2a89-4817-4227-a04f-638055901854 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:36.415688 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac2a89-4817-4227-a04f-638055901854 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:36.426518 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 539/1075] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 00:50:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:50:37.262457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5814e-eed6-4616-8915-fb77f6347b17 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:37.262995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5814e-eed6-4616-8915-fb77f6347b17 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:37.262995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5814e-eed6-4616-8915-fb77f6347b17 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:37.266193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 537/1076] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:37.270735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc68a-2806-466b-a861-50e1b13c8fe4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:37.271241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc68a-2806-466b-a861-50e1b13c8fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:37.271349 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc68a-2806-466b-a861-50e1b13c8fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:37.354026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-035bc68a-2806-466b-a861-50e1b13c8fe4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:37.355273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-035bc68a-2806-466b-a861-50e1b13c8fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:37.460853 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:37.508432 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 540/1077] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:37.840245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5814e-eed6-4616-8915-fb77f6347b17 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:37.844380 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-65b5814e-eed6-4616-8915-fb77f6347b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:38.011601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:38.105876 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5814e-eed6-4616-8915-fb77f6347b17 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:38.280711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c331775-6e68-4350-991f-0cb5c5b901b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:38.281807 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c331775-6e68-4350-991f-0cb5c5b901b8 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:38.282473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c331775-6e68-4350-991f-0cb5c5b901b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:38.283116 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c331775-6e68-4350-991f-0cb5c5b901b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:38.286503 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-5c331775-6e68-4350-991f-0cb5c5b901b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:38.398608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:38.424497 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c331775-6e68-4350-991f-0cb5c5b901b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:38.426822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c331775-6e68-4350-991f-0cb5c5b901b8 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:38.461493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 538/1078] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:41.087598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73904e-08e5-450a-ac7f-b2b0745ee1c1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:41.087598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73904e-08e5-450a-ac7f-b2b0745ee1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:41.087598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73904e-08e5-450a-ac7f-b2b0745ee1c1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:41.088748 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 541/1079] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:41.093959 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1d0b3-3d90-4252-a51f-c1dfd1854498 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:41.094512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1d0b3-3d90-4252-a51f-c1dfd1854498 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:41.094512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1d0b3-3d90-4252-a51f-c1dfd1854498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:41.214022 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b7f1d0b3-3d90-4252-a51f-c1dfd1854498 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:41.216112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b7f1d0b3-3d90-4252-a51f-c1dfd1854498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:41.392493 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 539/1080] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:41.747240 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73904e-08e5-450a-ac7f-b2b0745ee1c1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:41.750006 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5d73904e-08e5-450a-ac7f-b2b0745ee1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:41.984823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73904e-08e5-450a-ac7f-b2b0745ee1c1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:42.061732 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:42.154859 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98c02c-6511-484b-988c-c43bdac9e27d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:42.156038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98c02c-6511-484b-988c-c43bdac9e27d service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:42.156038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98c02c-6511-484b-988c-c43bdac9e27d service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:42.156038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98c02c-6511-484b-988c-c43bdac9e27d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:42.157672 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0d98c02c-6511-484b-988c-c43bdac9e27d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:42.286842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98c02c-6511-484b-988c-c43bdac9e27d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:42.288408 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98c02c-6511-484b-988c-c43bdac9e27d service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:42.317874 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 542/1081] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:44.753714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfb247-bde0-4c97-a0ae-345998031ad5 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:44.754290 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfb247-bde0-4c97-a0ae-345998031ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:44.754290 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfb247-bde0-4c97-a0ae-345998031ad5 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:44.755888 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 540/1082] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:44.762272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244a8bd-675b-41bc-9096-48745eba9e0c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:44.762851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244a8bd-675b-41bc-9096-48745eba9e0c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:44.762851 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244a8bd-675b-41bc-9096-48745eba9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:44.868521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5244a8bd-675b-41bc-9096-48745eba9e0c None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:44.870152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5244a8bd-675b-41bc-9096-48745eba9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:44.881713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:45.009771 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 543/1083] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:45.534852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfb247-bde0-4c97-a0ae-345998031ad5 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:45.536412 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b7cfb247-bde0-4c97-a0ae-345998031ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:45.596013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:45.737958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfb247-bde0-4c97-a0ae-345998031ad5 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:45.904944 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677c30-de52-43bd-a1c4-e9bd53d117a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:45.905874 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677c30-de52-43bd-a1c4-e9bd53d117a8 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:45.906169 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677c30-de52-43bd-a1c4-e9bd53d117a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:45.906443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677c30-de52-43bd-a1c4-e9bd53d117a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:45.908932 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9f677c30-de52-43bd-a1c4-e9bd53d117a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:45.917548 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:46.028271 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f677c30-de52-43bd-a1c4-e9bd53d117a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:46.030358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f677c30-de52-43bd-a1c4-e9bd53d117a8 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:46.053774 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 541/1084] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:55.009740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=39 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:56.051304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=42 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:00.472232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380a205-671c-4aca-837c-b1973be9f6ad None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:00.472836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380a205-671c-4aca-837c-b1973be9f6ad None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:00.472836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380a205-671c-4aca-837c-b1973be9f6ad None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:00.474198 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 544/1085] 10.222.0.23 () {54 vars in 918 bytes} [Sun Oct 16 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:00.479286 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66fc6-1658-4dae-b18d-dab5c5559619 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:00.479695 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66fc6-1658-4dae-b18d-dab5c5559619 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:00.479788 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66fc6-1658-4dae-b18d-dab5c5559619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:00.557131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b6d66fc6-1658-4dae-b18d-dab5c5559619 None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:00.558331 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b6d66fc6-1658-4dae-b18d-dab5c5559619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:00.668352 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 542/1086] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Oct 16 00:51:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:00.683331 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cdab3-88a1-41b2-9c4a-8d5ed764d204 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:00.683621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cdab3-88a1-41b2-9c4a-8d5ed764d204 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:00.683896 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cdab3-88a1-41b2-9c4a-8d5ed764d204 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:00.685837 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 545/1087] 10.222.0.23 () {54 vars in 918 bytes} [Sun Oct 16 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:00.690924 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe648ee-f181-4e3c-ac29-4fb04811bc8f None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:00.691205 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe648ee-f181-4e3c-ac29-4fb04811bc8f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:00.691476 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe648ee-f181-4e3c-ac29-4fb04811bc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:00.767490 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:00.770214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-3fe648ee-f181-4e3c-ac29-4fb04811bc8f None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:00.771964 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-3fe648ee-f181-4e3c-ac29-4fb04811bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:00.906185 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 543/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Oct 16 00:51:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:03.617923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f7dac-e51b-4a96-bc79-3d8619b0a32e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:03.618502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f7dac-e51b-4a96-bc79-3d8619b0a32e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:03.618502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f7dac-e51b-4a96-bc79-3d8619b0a32e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:03.619810 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 546/1089] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:51:03.626049 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264308b-81ea-4bb7-a545-00cbff98df07 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:03.626511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264308b-81ea-4bb7-a545-00cbff98df07 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:03.626608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264308b-81ea-4bb7-a545-00cbff98df07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:03.695910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-7264308b-81ea-4bb7-a545-00cbff98df07 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:03.697149 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-7264308b-81ea-4bb7-a545-00cbff98df07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:03.752984 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:03.795032 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 544/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:04.088423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f7dac-e51b-4a96-bc79-3d8619b0a32e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:04.090038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0d1f7dac-e51b-4a96-bc79-3d8619b0a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:04.242379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f7dac-e51b-4a96-bc79-3d8619b0a32e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:04.319930 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:04.360243 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4059-ecb9-4eba-9a69-d942231a153b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:04.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4059-ecb9-4eba-9a69-d942231a153b service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:04.361078 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4059-ecb9-4eba-9a69-d942231a153b service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:04.361355 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4059-ecb9-4eba-9a69-d942231a153b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:04.363036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd4d4059-ecb9-4eba-9a69-d942231a153b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:04.459860 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4059-ecb9-4eba-9a69-d942231a153b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:04.461718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4059-ecb9-4eba-9a69-d942231a153b service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:04.479677 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 547/1091] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:05.651617 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5238f5-c22f-469f-8422-29582a39da0a None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:05.652297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5238f5-c22f-469f-8422-29582a39da0a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:05.652297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5238f5-c22f-469f-8422-29582a39da0a None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:05.653579 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 545/1092] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:05.660017 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8a3d-759b-4702-95e9-abd53a6ecab4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:05.660558 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8a3d-759b-4702-95e9-abd53a6ecab4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:05.660661 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8a3d-759b-4702-95e9-abd53a6ecab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:05.738923 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-df4f8a3d-759b-4702-95e9-abd53a6ecab4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:05.740143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-df4f8a3d-759b-4702-95e9-abd53a6ecab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:05.768986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:05.844485 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 548/1093] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:05.999443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5238f5-c22f-469f-8422-29582a39da0a None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:06.000912 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-bb5238f5-c22f-469f-8422-29582a39da0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:06.150182 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5238f5-c22f-469f-8422-29582a39da0a None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:06.191335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:06.267306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1f2d-55f6-408c-96e7-6dbbf33e0691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:06.267833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1f2d-55f6-408c-96e7-6dbbf33e0691 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:06.268114 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1f2d-55f6-408c-96e7-6dbbf33e0691 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:06.268417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1f2d-55f6-408c-96e7-6dbbf33e0691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:06.270150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-8d3e1f2d-55f6-408c-96e7-6dbbf33e0691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:06.361616 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1f2d-55f6-408c-96e7-6dbbf33e0691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:06.363214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1f2d-55f6-408c-96e7-6dbbf33e0691 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:06.383292 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 546/1094] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:07.550184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6672d-d2e2-4916-af9d-a9f6a972dc81 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:07.550725 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6672d-d2e2-4916-af9d-a9f6a972dc81 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:07.550829 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6672d-d2e2-4916-af9d-a9f6a972dc81 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:07.552167 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 549/1095] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:07.558814 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238230-0766-475f-8e6e-ea9b2c0192ff None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:07.559320 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238230-0766-475f-8e6e-ea9b2c0192ff None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:07.559420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238230-0766-475f-8e6e-ea9b2c0192ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:07.615280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:07.637930 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-61238230-0766-475f-8e6e-ea9b2c0192ff None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:07.639172 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-61238230-0766-475f-8e6e-ea9b2c0192ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:07.738829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 547/1096] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:07.895729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6672d-d2e2-4916-af9d-a9f6a972dc81 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:07.897354 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6be6672d-d2e2-4916-af9d-a9f6a972dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:08.051724 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6672d-d2e2-4916-af9d-a9f6a972dc81 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:08.064653 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:08.168142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c676d59-3009-4c5a-b3e2-7391f432973b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:08.168674 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c676d59-3009-4c5a-b3e2-7391f432973b service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:08.168950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c676d59-3009-4c5a-b3e2-7391f432973b service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:08.169242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c676d59-3009-4c5a-b3e2-7391f432973b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:08.170839 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4c676d59-3009-4c5a-b3e2-7391f432973b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:08.264973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c676d59-3009-4c5a-b3e2-7391f432973b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:08.266591 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c676d59-3009-4c5a-b3e2-7391f432973b service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:08.284852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 550/1097] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:09.418457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319429e1-2616-4542-83db-bab53aa1b127 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:09.419038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319429e1-2616-4542-83db-bab53aa1b127 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:09.419038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319429e1-2616-4542-83db-bab53aa1b127 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:09.420907 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 548/1098] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:09.427681 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f63b5-f7a7-4976-aa74-cf0d7d1c904f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:09.428196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f63b5-f7a7-4976-aa74-cf0d7d1c904f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:09.428296 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f63b5-f7a7-4976-aa74-cf0d7d1c904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:09.448976 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:09.507382 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-be3f63b5-f7a7-4976-aa74-cf0d7d1c904f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:09.508593 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-be3f63b5-f7a7-4976-aa74-cf0d7d1c904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:09.606387 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 551/1099] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:09.761135 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319429e1-2616-4542-83db-bab53aa1b127 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:09.762601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-319429e1-2616-4542-83db-bab53aa1b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:09.876539 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:09.916469 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319429e1-2616-4542-83db-bab53aa1b127 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:10.033491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37a186-666e-43e6-9c90-8f94dc867b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:10.034003 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37a186-666e-43e6-9c90-8f94dc867b80 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:10.034278 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37a186-666e-43e6-9c90-8f94dc867b80 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:10.034546 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37a186-666e-43e6-9c90-8f94dc867b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:10.036148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-8d37a186-666e-43e6-9c90-8f94dc867b80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:10.123439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:10.139722 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37a186-666e-43e6-9c90-8f94dc867b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:10.141365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37a186-666e-43e6-9c90-8f94dc867b80 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:10.160673 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 549/1100] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:11.336901 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d517-4638-4190-add5-1f1be89405f2 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:11.337469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d517-4638-4190-add5-1f1be89405f2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:11.337469 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d517-4638-4190-add5-1f1be89405f2 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:11.338787 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 552/1101] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:11.346264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabcd40-bbb0-41f0-b881-d2c79f8320d4 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:11.346763 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabcd40-bbb0-41f0-b881-d2c79f8320d4 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:11.346858 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabcd40-bbb0-41f0-b881-d2c79f8320d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:11.428995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-afabcd40-bbb0-41f0-b881-d2c79f8320d4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:11.430254 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-afabcd40-bbb0-41f0-b881-d2c79f8320d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:11.527704 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 550/1102] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:11.682211 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d517-4638-4190-add5-1f1be89405f2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:11.683788 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7e25d517-4638-4190-add5-1f1be89405f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:11.774126 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:11.837645 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d517-4638-4190-add5-1f1be89405f2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:11.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8891592-81c4-4d8c-89b4-b4e45eeb7565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:11.956138 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8891592-81c4-4d8c-89b4-b4e45eeb7565 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:11.956454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8891592-81c4-4d8c-89b4-b4e45eeb7565 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:11.956726 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8891592-81c4-4d8c-89b4-b4e45eeb7565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:11.958342 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c8891592-81c4-4d8c-89b4-b4e45eeb7565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:12.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:12.052486 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8891592-81c4-4d8c-89b4-b4e45eeb7565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:12.054091 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8891592-81c4-4d8c-89b4-b4e45eeb7565 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:12.071695 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 553/1103] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:13.148759 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862cd3-f3ba-4163-b1dc-7284c9ab1c7d None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:13.149296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862cd3-f3ba-4163-b1dc-7284c9ab1c7d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:13.149296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862cd3-f3ba-4163-b1dc-7284c9ab1c7d None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:13.150525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 551/1104] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:13.157719 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b94c8-2a21-42cb-80c6-7aab703961b8 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:13.158224 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b94c8-2a21-42cb-80c6-7aab703961b8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:13.158337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b94c8-2a21-42cb-80c6-7aab703961b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:13.235455 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-602b94c8-2a21-42cb-80c6-7aab703961b8 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:13.236718 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-602b94c8-2a21-42cb-80c6-7aab703961b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:13.334632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 554/1105] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:13.486545 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862cd3-f3ba-4163-b1dc-7284c9ab1c7d None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:13.488052 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4a862cd3-f3ba-4163-b1dc-7284c9ab1c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:13.540044 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:13.641758 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862cd3-f3ba-4163-b1dc-7284c9ab1c7d None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:13.762637 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925dd54-0905-46dd-8b1e-fa4ba7fca3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:13.763223 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925dd54-0905-46dd-8b1e-fa4ba7fca3ac service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:13.763524 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925dd54-0905-46dd-8b1e-fa4ba7fca3ac service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:13.763797 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925dd54-0905-46dd-8b1e-fa4ba7fca3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:13.765555 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4925dd54-0905-46dd-8b1e-fa4ba7fca3ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:13.772942 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:13.865346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925dd54-0905-46dd-8b1e-fa4ba7fca3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:13.866956 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925dd54-0905-46dd-8b1e-fa4ba7fca3ac service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:13.885724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 552/1106] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:14.985875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e559-03c0-4a33-b1f5-9e9b765aeac8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:14.986460 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e559-03c0-4a33-b1f5-9e9b765aeac8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:14.986460 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e559-03c0-4a33-b1f5-9e9b765aeac8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:14.987735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 555/1107] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:14.994369 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600eb5-8cfa-4998-893b-29501f93a619 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:14.994853 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600eb5-8cfa-4998-893b-29501f93a619 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:14.994958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600eb5-8cfa-4998-893b-29501f93a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:15.077253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-1b600eb5-8cfa-4998-893b-29501f93a619 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:15.078474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1b600eb5-8cfa-4998-893b-29501f93a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:15.146660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:15.176793 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 553/1108] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:15.330413 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e559-03c0-4a33-b1f5-9e9b765aeac8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:15.331942 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6c33e559-03c0-4a33-b1f5-9e9b765aeac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:15.351174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:15.486400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e559-03c0-4a33-b1f5-9e9b765aeac8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:15.575178 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:15.601836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd8e2c-f7c6-4dd7-b0d2-971805cb4fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:15.602395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd8e2c-f7c6-4dd7-b0d2-971805cb4fb3 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:15.602675 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd8e2c-f7c6-4dd7-b0d2-971805cb4fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:15.602950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd8e2c-f7c6-4dd7-b0d2-971805cb4fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:15.604639 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cabd8e2c-f7c6-4dd7-b0d2-971805cb4fb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:15.696834 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd8e2c-f7c6-4dd7-b0d2-971805cb4fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:15.698439 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd8e2c-f7c6-4dd7-b0d2-971805cb4fb3 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:15.717217 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 556/1109] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:16.789645 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c28fc6-011e-4675-95b3-1450797d15ab None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:16.790240 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c28fc6-011e-4675-95b3-1450797d15ab None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:16.790240 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c28fc6-011e-4675-95b3-1450797d15ab None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:16.791522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 554/1110] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:16.798619 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b271-52a6-41d1-bc2b-57af7408fb23 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:16.799132 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b271-52a6-41d1-bc2b-57af7408fb23 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:16.799247 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b271-52a6-41d1-bc2b-57af7408fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:16.875276 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c769b271-52a6-41d1-bc2b-57af7408fb23 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:16.876520 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c769b271-52a6-41d1-bc2b-57af7408fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:16.919972 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:16.983895 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 557/1111] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:17.135913 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c28fc6-011e-4675-95b3-1450797d15ab None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:17.137475 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c9c28fc6-011e-4675-95b3-1450797d15ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:17.292347 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c28fc6-011e-4675-95b3-1450797d15ab None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:17.349905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:17.413798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e779-9b56-41d3-b05d-14e3a4822c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:17.414317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e779-9b56-41d3-b05d-14e3a4822c9c service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:17.414602 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e779-9b56-41d3-b05d-14e3a4822c9c service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:17.414875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e779-9b56-41d3-b05d-14e3a4822c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:17.416536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-2e29e779-9b56-41d3-b05d-14e3a4822c9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:17.511396 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e779-9b56-41d3-b05d-14e3a4822c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:17.513771 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e779-9b56-41d3-b05d-14e3a4822c9c service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:17.535067 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 555/1112] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:18.612366 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaee87-161c-4a08-b721-7ccb8e46e6b7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:18.612971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaee87-161c-4a08-b721-7ccb8e46e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:18.612971 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaee87-161c-4a08-b721-7ccb8e46e6b7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:18.614291 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 558/1113] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:18.621293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacc3b-67e0-4e0c-997e-2e48729b8cb2 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:18.621762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacc3b-67e0-4e0c-997e-2e48729b8cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:18.621872 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacc3b-67e0-4e0c-997e-2e48729b8cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:18.701476 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-cfeacc3b-67e0-4e0c-997e-2e48729b8cb2 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:18.702705 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-cfeacc3b-67e0-4e0c-997e-2e48729b8cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:18.704762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:18.800588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 556/1114] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:18.954926 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaee87-161c-4a08-b721-7ccb8e46e6b7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:18.956454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6dfaee87-161c-4a08-b721-7ccb8e46e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:19.107203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaee87-161c-4a08-b721-7ccb8e46e6b7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:19.134678 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:19.224071 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a71f1-2eb4-4617-b9d4-92c2e5b6170d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:19.224990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a71f1-2eb4-4617-b9d4-92c2e5b6170d service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:19.224990 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a71f1-2eb4-4617-b9d4-92c2e5b6170d service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:19.225180 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a71f1-2eb4-4617-b9d4-92c2e5b6170d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:19.226750 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-476a71f1-2eb4-4617-b9d4-92c2e5b6170d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:19.318273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a71f1-2eb4-4617-b9d4-92c2e5b6170d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:19.319888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a71f1-2eb4-4617-b9d4-92c2e5b6170d service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:19.338807 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 559/1115] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:21.500880 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45963615-40d0-41a2-9a01-d990cbb6f8f7 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:21.501400 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45963615-40d0-41a2-9a01-d990cbb6f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:21.501499 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45963615-40d0-41a2-9a01-d990cbb6f8f7 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:21.502825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 557/1116] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:21.508788 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b1f7d-d30b-4182-a9b5-ae597deabe8b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:21.509318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b1f7d-d30b-4182-a9b5-ae597deabe8b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:21.509318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b1f7d-d30b-4182-a9b5-ae597deabe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:21.550866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:21.578672 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-413b1f7d-d30b-4182-a9b5-ae597deabe8b None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:21.579888 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-413b1f7d-d30b-4182-a9b5-ae597deabe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:21.679794 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 560/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:21.983744 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72b3f-384c-4770-a0f5-4089fb204da5 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:21.984035 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72b3f-384c-4770-a0f5-4089fb204da5 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:21.984335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72b3f-384c-4770-a0f5-4089fb204da5 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:21.985689 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 558/1118] 10.222.0.23 () {54 vars in 964 bytes} [Sun Oct 16 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:21.991555 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2064-a951-42c9-bc0a-8fe58def4edb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:21.991846 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2064-a951-42c9-bc0a-8fe58def4edb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:21.992120 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2064-a951-42c9-bc0a-8fe58def4edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:22.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-07ba2064-a951-42c9-bc0a-8fe58def4edb None None] MFA Rules not processed for user `aaaeca0952f04f229b9d53ce1625a1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:22.072767 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-07ba2064-a951-42c9-bc0a-8fe58def4edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:22.125271 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:22.149226 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 561/1119] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 16 00:51:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:22.158350 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f72b3f-384c-4770-a0f5-4089fb204da5 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:22.159936 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-69f72b3f-384c-4770-a0f5-4089fb204da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:22.265439 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f72b3f-384c-4770-a0f5-4089fb204da5 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:22.298652 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:22.341405 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07ad0b-2510-482a-8894-b0e521fc2bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:22.342100 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07ad0b-2510-482a-8894-b0e521fc2bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:22.342381 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07ad0b-2510-482a-8894-b0e521fc2bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:22.342652 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07ad0b-2510-482a-8894-b0e521fc2bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:22.344266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-df07ad0b-2510-482a-8894-b0e521fc2bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:22.459976 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07ad0b-2510-482a-8894-b0e521fc2bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:22.461466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07ad0b-2510-482a-8894-b0e521fc2bf5 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:22.479479 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 559/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:25.221273 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a2d23-b5c7-4fe2-856a-5e9ac0669b01 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:25.221868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a2d23-b5c7-4fe2-856a-5e9ac0669b01 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:25.221868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a2d23-b5c7-4fe2-856a-5e9ac0669b01 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:25.223207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 562/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:25.228916 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edb44-d603-454f-bf73-7c09e5a61f6f None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:25.229343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edb44-d603-454f-bf73-7c09e5a61f6f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:25.229466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edb44-d603-454f-bf73-7c09e5a61f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:25.296567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-ae0edb44-d603-454f-bf73-7c09e5a61f6f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:25.297780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-ae0edb44-d603-454f-bf73-7c09e5a61f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:25.311236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:25.395368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 560/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:25.685676 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a2d23-b5c7-4fe2-856a-5e9ac0669b01 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:25.687270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-951a2d23-b5c7-4fe2-856a-5e9ac0669b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:25.800941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a2d23-b5c7-4fe2-856a-5e9ac0669b01 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:25.877957 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffc68d-3b4c-40ec-833b-a9b929f15e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:25.878573 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc68d-3b4c-40ec-833b-a9b929f15e23 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:25.878857 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc68d-3b4c-40ec-833b-a9b929f15e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:25.879137 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc68d-3b4c-40ec-833b-a9b929f15e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:25.880818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-dfffc68d-3b4c-40ec-833b-a9b929f15e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:25.914011 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:25.996031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc68d-3b4c-40ec-833b-a9b929f15e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:25.998064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc68d-3b4c-40ec-833b-a9b929f15e23 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:26.020157 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 563/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:28.560577 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784c860-0ca9-4365-b47b-f2eabbf8f357 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:28.561135 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784c860-0ca9-4365-b47b-f2eabbf8f357 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:28.561135 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784c860-0ca9-4365-b47b-f2eabbf8f357 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:28.562483 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 561/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:28.567790 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc424b8-5646-4098-80fe-b26ddb14bf12 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:28.568174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc424b8-5646-4098-80fe-b26ddb14bf12 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:28.568367 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc424b8-5646-4098-80fe-b26ddb14bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:28.635197 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-cbc424b8-5646-4098-80fe-b26ddb14bf12 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:28.636461 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cbc424b8-5646-4098-80fe-b26ddb14bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:28.716323 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:28.736910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 564/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:29.023425 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784c860-0ca9-4365-b47b-f2eabbf8f357 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:29.024973 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-3784c860-0ca9-4365-b47b-f2eabbf8f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:29.130846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784c860-0ca9-4365-b47b-f2eabbf8f357 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:29.176722 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:29.213696 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9223d7-fcab-47e4-9b21-1519707c8aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:29.214300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9223d7-fcab-47e4-9b21-1519707c8aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:29.214575 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9223d7-fcab-47e4-9b21-1519707c8aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:29.214846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9223d7-fcab-47e4-9b21-1519707c8aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:29.216532 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-ca9223d7-fcab-47e4-9b21-1519707c8aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:29.329344 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9223d7-fcab-47e4-9b21-1519707c8aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:29.330779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9223d7-fcab-47e4-9b21-1519707c8aa6 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:29.349135 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 562/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:31.690744 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3258ea4-aea2-4e06-b145-1cd2e8795fce None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:31.691349 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3258ea4-aea2-4e06-b145-1cd2e8795fce None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:31.691349 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3258ea4-aea2-4e06-b145-1cd2e8795fce None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:31.692675 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 565/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:31.697962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8da2a-3fda-4d87-ae7e-51e074fba79a None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:31.698375 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8da2a-3fda-4d87-ae7e-51e074fba79a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:31.698514 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8da2a-3fda-4d87-ae7e-51e074fba79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:31.767395 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-03f8da2a-3fda-4d87-ae7e-51e074fba79a None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:31.768627 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-03f8da2a-3fda-4d87-ae7e-51e074fba79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:31.789225 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:31.867443 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 563/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:32.163426 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3258ea4-aea2-4e06-b145-1cd2e8795fce None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:32.165070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c3258ea4-aea2-4e06-b145-1cd2e8795fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:32.285686 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3258ea4-aea2-4e06-b145-1cd2e8795fce None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:32.369464 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4da31-446c-4310-8508-c4b8671a5f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:32.370210 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4da31-446c-4310-8508-c4b8671a5f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:32.370753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4da31-446c-4310-8508-c4b8671a5f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:32.371203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4da31-446c-4310-8508-c4b8671a5f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:32.374162 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-98a4da31-446c-4310-8508-c4b8671a5f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:32.427422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:32.516994 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4da31-446c-4310-8508-c4b8671a5f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:32.518798 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4da31-446c-4310-8508-c4b8671a5f74 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:32.540262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 566/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:34.853883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142195-abd1-46fa-84ca-bcb94406524c None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:34.854641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142195-abd1-46fa-84ca-bcb94406524c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:34.854641 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142195-abd1-46fa-84ca-bcb94406524c None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:34.856420 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 564/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:34.862308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2901c-396f-41b7-81d0-29f141432ef9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:34.862795 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2901c-396f-41b7-81d0-29f141432ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:34.862896 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2901c-396f-41b7-81d0-29f141432ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:34.930314 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9da2901c-396f-41b7-81d0-29f141432ef9 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:34.931543 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9da2901c-396f-41b7-81d0-29f141432ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.025831 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:35.032517 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 567/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:35.320825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a142195-abd1-46fa-84ca-bcb94406524c None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:35.322386 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-7a142195-abd1-46fa-84ca-bcb94406524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.432817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a142195-abd1-46fa-84ca-bcb94406524c None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:35.488691 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:35.514488 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bb815-d534-4f0f-a348-771e4c221765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:35.515095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb815-d534-4f0f-a348-771e4c221765 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:35.515379 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb815-d534-4f0f-a348-771e4c221765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:35.515655 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb815-d534-4f0f-a348-771e4c221765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:35.517314 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-054bb815-d534-4f0f-a348-771e4c221765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.631465 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bb815-d534-4f0f-a348-771e4c221765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:35.632980 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bb815-d534-4f0f-a348-771e4c221765 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:35.651783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 565/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:37.895065 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6e29b-b7f9-4357-9dad-9d100b75b9f6 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:37.895698 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6e29b-b7f9-4357-9dad-9d100b75b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:37.895698 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6e29b-b7f9-4357-9dad-9d100b75b9f6 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:37.897137 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 568/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:37.902710 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559bd7e-694a-4264-b104-1e78e9eae120 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:37.903191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559bd7e-694a-4264-b104-1e78e9eae120 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:37.903331 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559bd7e-694a-4264-b104-1e78e9eae120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:37.973484 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b559bd7e-694a-4264-b104-1e78e9eae120 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:37.974612 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b559bd7e-694a-4264-b104-1e78e9eae120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:38.004895 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:38.073700 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 566/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:38.370326 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6e29b-b7f9-4357-9dad-9d100b75b9f6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:38.372510 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d0d6e29b-b7f9-4357-9dad-9d100b75b9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:38.485489 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6e29b-b7f9-4357-9dad-9d100b75b9f6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:38.560749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa6bc0-9058-41e9-90ad-b305d05b09d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:38.561362 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa6bc0-9058-41e9-90ad-b305d05b09d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:38.561641 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa6bc0-9058-41e9-90ad-b305d05b09d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:38.561914 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa6bc0-9058-41e9-90ad-b305d05b09d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:38.563556 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4caa6bc0-9058-41e9-90ad-b305d05b09d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:38.615731 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:38.682618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa6bc0-9058-41e9-90ad-b305d05b09d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:38.684071 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa6bc0-9058-41e9-90ad-b305d05b09d9 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:38.705259 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 569/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:40.947997 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30fab-ddfd-45de-9b2b-292215e16e4c None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:40.948619 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30fab-ddfd-45de-9b2b-292215e16e4c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:40.948619 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30fab-ddfd-45de-9b2b-292215e16e4c None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:40.950571 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:40.956053 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651176da-f6f9-4208-96e7-6e31d0f4cafe None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:40.956549 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651176da-f6f9-4208-96e7-6e31d0f4cafe None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:40.956656 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651176da-f6f9-4208-96e7-6e31d0f4cafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:41.024172 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-651176da-f6f9-4208-96e7-6e31d0f4cafe None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:41.025419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-651176da-f6f9-4208-96e7-6e31d0f4cafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:41.126218 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:41.412920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30fab-ddfd-45de-9b2b-292215e16e4c None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:41.414510 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-f5c30fab-ddfd-45de-9b2b-292215e16e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:41.530272 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30fab-ddfd-45de-9b2b-292215e16e4c None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:41.587911 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:41.607843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637060f-c517-489a-b11a-3919802e926e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:41.608487 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637060f-c517-489a-b11a-3919802e926e service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:41.608772 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637060f-c517-489a-b11a-3919802e926e service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:41.609045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637060f-c517-489a-b11a-3919802e926e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:41.610666 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-6637060f-c517-489a-b11a-3919802e926e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:41.727006 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637060f-c517-489a-b11a-3919802e926e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:41.728542 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637060f-c517-489a-b11a-3919802e926e service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:41.749111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 568/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:43.994096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756cc5-ea08-4e4c-9b23-2037778a91d6 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:43.994636 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756cc5-ea08-4e4c-9b23-2037778a91d6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:43.994636 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46756cc5-ea08-4e4c-9b23-2037778a91d6 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:43.995926 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:44.001939 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f0a9c-fb8b-4bc4-a0d9-f76d6e56caee None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:44.002388 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f0a9c-fb8b-4bc4-a0d9-f76d6e56caee None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:44.002494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f0a9c-fb8b-4bc4-a0d9-f76d6e56caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:44.070563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-c05f0a9c-fb8b-4bc4-a0d9-f76d6e56caee None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:44.071787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c05f0a9c-fb8b-4bc4-a0d9-f76d6e56caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:44.111491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:44.173998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:44.457980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756cc5-ea08-4e4c-9b23-2037778a91d6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:44.459828 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-46756cc5-ea08-4e4c-9b23-2037778a91d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:44.463901 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:44.565479 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46756cc5-ea08-4e4c-9b23-2037778a91d6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:44.643288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f3008-707f-4e40-89b9-5de3b7a3911a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:44.643897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3008-707f-4e40-89b9-5de3b7a3911a service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:44.644181 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3008-707f-4e40-89b9-5de3b7a3911a service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:44.644560 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3008-707f-4e40-89b9-5de3b7a3911a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:44.646207 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-eb9f3008-707f-4e40-89b9-5de3b7a3911a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:44.710274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:44.763620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f3008-707f-4e40-89b9-5de3b7a3911a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:44.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f3008-707f-4e40-89b9-5de3b7a3911a service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:44.784478 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 572/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:47.123798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8dab-07f0-4c1c-8d32-2abd6023a00c None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:47.124507 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8dab-07f0-4c1c-8d32-2abd6023a00c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:47.124507 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8dab-07f0-4c1c-8d32-2abd6023a00c None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:47.125711 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:47.131610 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a7428-831c-4f37-8921-c862ebf160d4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:47.132155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a7428-831c-4f37-8921-c862ebf160d4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:47.132155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a7428-831c-4f37-8921-c862ebf160d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:47.201095 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-162a7428-831c-4f37-8921-c862ebf160d4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:47.202550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-162a7428-831c-4f37-8921-c862ebf160d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:47.301740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:47.587349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8dab-07f0-4c1c-8d32-2abd6023a00c None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:47.589070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9e3a8dab-07f0-4c1c-8d32-2abd6023a00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:47.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8dab-07f0-4c1c-8d32-2abd6023a00c None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:47.761422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:47.768588 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be380f8-c7e0-4e6f-9055-4f8e23f61c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:47.769191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be380f8-c7e0-4e6f-9055-4f8e23f61c8a service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:47.769466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be380f8-c7e0-4e6f-9055-4f8e23f61c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:47.769734 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be380f8-c7e0-4e6f-9055-4f8e23f61c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:47.771328 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1be380f8-c7e0-4e6f-9055-4f8e23f61c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:47.882832 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be380f8-c7e0-4e6f-9055-4f8e23f61c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:47.884176 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be380f8-c7e0-4e6f-9055-4f8e23f61c8a service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:47.902036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 571/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:50.086088 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356d7c-63c7-425f-b2ce-91de3cf8fdd8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:50.086633 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356d7c-63c7-425f-b2ce-91de3cf8fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:50.086633 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356d7c-63c7-425f-b2ce-91de3cf8fdd8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:50.087973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:50.093542 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee542-f98d-4fdf-9cd0-f2d807e3ddcc None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:50.093990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee542-f98d-4fdf-9cd0-f2d807e3ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:50.094130 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee542-f98d-4fdf-9cd0-f2d807e3ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:50.162882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-a17ee542-f98d-4fdf-9cd0-f2d807e3ddcc None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:50.164097 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a17ee542-f98d-4fdf-9cd0-f2d807e3ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:50.216071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:50.266873 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:50.563171 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5356d7c-63c7-425f-b2ce-91de3cf8fdd8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:50.564769 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d5356d7c-63c7-425f-b2ce-91de3cf8fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:50.579143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:50.674929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5356d7c-63c7-425f-b2ce-91de3cf8fdd8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:50.750089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca210-90bd-4740-b629-5782cbb04798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:50.750704 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca210-90bd-4740-b629-5782cbb04798 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:50.750989 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca210-90bd-4740-b629-5782cbb04798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:50.751299 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca210-90bd-4740-b629-5782cbb04798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:50.753024 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9b5ca210-90bd-4740-b629-5782cbb04798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:50.825177 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:50.873213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ca210-90bd-4740-b629-5782cbb04798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:50.874674 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ca210-90bd-4740-b629-5782cbb04798 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:50.894031 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 575/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:00.265297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=22 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:00.891604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=25 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:11.195786 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba957d-c277-40c9-a3d5-1bbf03730d4a None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.196457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba957d-c277-40c9-a3d5-1bbf03730d4a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.196457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba957d-c277-40c9-a3d5-1bbf03730d4a None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.197698 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 573/1148] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:11.203946 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f147e-4ba4-49e3-83d3-def677fcbe41 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.204483 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f147e-4ba4-49e3-83d3-def677fcbe41 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.204583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f147e-4ba4-49e3-83d3-def677fcbe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.271473 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a27f147e-4ba4-49e3-83d3-def677fcbe41 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:11.272748 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a27f147e-4ba4-49e3-83d3-def677fcbe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.376911 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 576/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:11.673470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85aad-9bf1-41cf-b43a-410af7208a56 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.673756 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85aad-9bf1-41cf-b43a-410af7208a56 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.674036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85aad-9bf1-41cf-b43a-410af7208a56 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.675382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 574/1150] 10.222.0.23 () {54 vars in 962 bytes} [Sun Oct 16 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:11.680479 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e68f0-0151-48f2-bb65-01569afe06b6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.680770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e68f0-0151-48f2-bb65-01569afe06b6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.681044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e68f0-0151-48f2-bb65-01569afe06b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.765463 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-860e68f0-0151-48f2-bb65-01569afe06b6 None None] MFA Rules not processed for user `18da5473168d4998bb38de305174819c`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:11.766669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-860e68f0-0151-48f2-bb65-01569afe06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.786882 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:11.844175 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 577/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 16 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:11.851914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85aad-9bf1-41cf-b43a-410af7208a56 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:11.853487 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-74c85aad-9bf1-41cf-b43a-410af7208a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.961227 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85aad-9bf1-41cf-b43a-410af7208a56 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:12.037266 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581be38-7bb5-4d4c-9b0a-b46bacc4a405 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18da5473168d4998bb38de305174819c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:12.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581be38-7bb5-4d4c-9b0a-b46bacc4a405 service glance] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:12.038140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581be38-7bb5-4d4c-9b0a-b46bacc4a405 service glance] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:12.038407 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581be38-7bb5-4d4c-9b0a-b46bacc4a405 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:12.039991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-6581be38-7bb5-4d4c-9b0a-b46bacc4a405 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:12.095004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:12.150070 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581be38-7bb5-4d4c-9b0a-b46bacc4a405 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:12.152074 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581be38-7bb5-4d4c-9b0a-b46bacc4a405 service glance] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:12.171453 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 575/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:14.463033 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951173b0-f5a5-4eae-864e-63303e46c3cb None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:14.463600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951173b0-f5a5-4eae-864e-63303e46c3cb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:14.463600 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951173b0-f5a5-4eae-864e-63303e46c3cb None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:14.465002 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 578/1153] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:14.470520 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348154-46a1-47a0-8e7d-7d1603d0bd9c None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:14.470991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348154-46a1-47a0-8e7d-7d1603d0bd9c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:14.471099 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348154-46a1-47a0-8e7d-7d1603d0bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:14.538350 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-fc348154-46a1-47a0-8e7d-7d1603d0bd9c None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:14.539470 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-fc348154-46a1-47a0-8e7d-7d1603d0bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:14.640033 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 576/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:14.926163 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951173b0-f5a5-4eae-864e-63303e46c3cb None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:14.927737 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-951173b0-f5a5-4eae-864e-63303e46c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:15.063001 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951173b0-f5a5-4eae-864e-63303e46c3cb None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:15.114080 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:15.162663 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d20b-07fc-4498-b41c-2ed34cb47ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:15.163282 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d20b-07fc-4498-b41c-2ed34cb47ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:15.163564 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d20b-07fc-4498-b41c-2ed34cb47ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:15.163840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d20b-07fc-4498-b41c-2ed34cb47ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:15.164513 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874d20b-07fc-4498-b41c-2ed34cb47ffe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:15.165628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-c874d20b-07fc-4498-b41c-2ed34cb47ffe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:52:15.165628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:52:15.165628 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:52:15.166805 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874d20b-07fc-4498-b41c-2ed34cb47ffe admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:15.187907 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 579/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 16 00:52:14 2022] GET /identity/v3/projects => generated 2553 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:52:17.376112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e758d-f87e-4762-b3e9-912c408532e7 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:17.376768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e758d-f87e-4762-b3e9-912c408532e7 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:17.376768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e758d-f87e-4762-b3e9-912c408532e7 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:17.378036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 577/1156] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:17.383693 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2938e-9fb3-4c30-9740-ce2719a21fa1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:17.384136 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2938e-9fb3-4c30-9740-ce2719a21fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:17.384243 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2938e-9fb3-4c30-9740-ce2719a21fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:17.451527 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-27c2938e-9fb3-4c30-9740-ce2719a21fa1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:17.452782 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-27c2938e-9fb3-4c30-9740-ce2719a21fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:17.548620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 580/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:17.840926 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e758d-f87e-4762-b3e9-912c408532e7 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:17.842442 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c77e758d-f87e-4762-b3e9-912c408532e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:17.852098 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:17.987968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e758d-f87e-4762-b3e9-912c408532e7 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:18.070548 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:18.105964 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc165fc-25f8-4837-82e9-753872e27652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:18.105964 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc165fc-25f8-4837-82e9-753872e27652 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:18.106293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc165fc-25f8-4837-82e9-753872e27652 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:18.106293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc165fc-25f8-4837-82e9-753872e27652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:18.107855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-adc165fc-25f8-4837-82e9-753872e27652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:18.202773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc165fc-25f8-4837-82e9-753872e27652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:18.204425 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc165fc-25f8-4837-82e9-753872e27652 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:18.225613 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 578/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:20.610090 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8df139-440d-4d74-b1dc-0c05aa21432b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:20.610658 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8df139-440d-4d74-b1dc-0c05aa21432b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:20.610658 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8df139-440d-4d74-b1dc-0c05aa21432b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:20.612005 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 581/1159] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:20.617370 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2be1b6-dc11-4001-800e-e50b5fdb9b43 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2be1b6-dc11-4001-800e-e50b5fdb9b43 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:20.617942 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2be1b6-dc11-4001-800e-e50b5fdb9b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:20.687972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-6f2be1b6-dc11-4001-800e-e50b5fdb9b43 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:20.689226 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-6f2be1b6-dc11-4001-800e-e50b5fdb9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:20.738389 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:20.789871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 579/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:21.079262 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8df139-440d-4d74-b1dc-0c05aa21432b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:21.080840 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4c8df139-440d-4d74-b1dc-0c05aa21432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:21.106780 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:21.203096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8df139-440d-4d74-b1dc-0c05aa21432b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:21.286864 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e41983-bcf9-4369-9eae-6ba7bd3da19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:21.287486 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e41983-bcf9-4369-9eae-6ba7bd3da19a service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:21.287770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e41983-bcf9-4369-9eae-6ba7bd3da19a service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:21.288044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e41983-bcf9-4369-9eae-6ba7bd3da19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:21.289781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-51e41983-bcf9-4369-9eae-6ba7bd3da19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:21.378227 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:21.425236 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e41983-bcf9-4369-9eae-6ba7bd3da19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:21.426679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e41983-bcf9-4369-9eae-6ba7bd3da19a service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:21.445545 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 582/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:23.670967 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ee34b-4fca-48bc-9fd3-ef8e0b2442f4 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:23.671668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ee34b-4fca-48bc-9fd3-ef8e0b2442f4 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:23.671849 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ee34b-4fca-48bc-9fd3-ef8e0b2442f4 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:23.673454 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 580/1162] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:23.678915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9fa81-d7df-43df-b0b1-018bbaa2e172 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:23.679364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9fa81-d7df-43df-b0b1-018bbaa2e172 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:23.679474 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9fa81-d7df-43df-b0b1-018bbaa2e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:23.746168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e8f9fa81-d7df-43df-b0b1-018bbaa2e172 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:23.747373 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e8f9fa81-d7df-43df-b0b1-018bbaa2e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:23.845089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 583/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:24.134234 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ee34b-4fca-48bc-9fd3-ef8e0b2442f4 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:24.136210 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-962ee34b-4fca-48bc-9fd3-ef8e0b2442f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:24.244887 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ee34b-4fca-48bc-9fd3-ef8e0b2442f4 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:24.318268 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:24.319762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f591b-1e31-4389-9796-e9a0721cc41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:24.320415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f591b-1e31-4389-9796-e9a0721cc41f service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:24.321055 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f591b-1e31-4389-9796-e9a0721cc41f service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:24.321380 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f591b-1e31-4389-9796-e9a0721cc41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:24.323725 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-146f591b-1e31-4389-9796-e9a0721cc41f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:24.434062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f591b-1e31-4389-9796-e9a0721cc41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:24.435423 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f591b-1e31-4389-9796-e9a0721cc41f service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:24.454618 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 581/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:26.819920 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326aa3-659f-47fe-b36f-d8108214bbf0 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:26.820539 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326aa3-659f-47fe-b36f-d8108214bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:26.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326aa3-659f-47fe-b36f-d8108214bbf0 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:26.822017 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 584/1165] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:26.828686 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117777d-c160-46c8-8d15-f9ee9395bd1d None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:26.829283 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117777d-c160-46c8-8d15-f9ee9395bd1d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:26.829283 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117777d-c160-46c8-8d15-f9ee9395bd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:26.910281 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-3117777d-c160-46c8-8d15-f9ee9395bd1d None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:26.911404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-3117777d-c160-46c8-8d15-f9ee9395bd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:26.972002 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:27.022488 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 582/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:27.325586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326aa3-659f-47fe-b36f-d8108214bbf0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:27.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b2326aa3-659f-47fe-b36f-d8108214bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:27.374175 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:27.459614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326aa3-659f-47fe-b36f-d8108214bbf0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:27.555467 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a445-2709-4ae7-9e6f-cafc9977eac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:27.556087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a445-2709-4ae7-9e6f-cafc9977eac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:27.556394 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a445-2709-4ae7-9e6f-cafc9977eac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:27.556671 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a445-2709-4ae7-9e6f-cafc9977eac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:27.559490 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8478a445-2709-4ae7-9e6f-cafc9977eac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:27.660199 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:27.697815 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a445-2709-4ae7-9e6f-cafc9977eac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:27.699963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a445-2709-4ae7-9e6f-cafc9977eac0 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:27.722757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 585/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:30.208086 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0da56-29e4-446c-ae00-921b685a02bd None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:30.208692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0da56-29e4-446c-ae00-921b685a02bd None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:30.208692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0da56-29e4-446c-ae00-921b685a02bd None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:30.210304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 583/1168] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 16 00:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:30.216672 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef444f3-96fe-4250-8e42-9ea4bf594d75 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:30.217253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef444f3-96fe-4250-8e42-9ea4bf594d75 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:30.217253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef444f3-96fe-4250-8e42-9ea4bf594d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:30.286214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2ef444f3-96fe-4250-8e42-9ea4bf594d75 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:30.287428 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2ef444f3-96fe-4250-8e42-9ea4bf594d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:30.386742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 586/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 16 00:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:30.677174 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0da56-29e4-446c-ae00-921b685a02bd None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:30.678801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-93f0da56-29e4-446c-ae00-921b685a02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:30.785985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0da56-29e4-446c-ae00-921b685a02bd None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:30.858761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f501a11-0cea-492b-bbcf-7d937c788825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:30.859361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f501a11-0cea-492b-bbcf-7d937c788825 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:30.859636 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f501a11-0cea-492b-bbcf-7d937c788825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:30.859909 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f501a11-0cea-492b-bbcf-7d937c788825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:30.861536 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-3f501a11-0cea-492b-bbcf-7d937c788825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:30.872861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:30.979587 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f501a11-0cea-492b-bbcf-7d937c788825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:30.980925 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f501a11-0cea-492b-bbcf-7d937c788825 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:30.999485 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 584/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:40.384595 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=82 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:40.997183 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=50 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:46.080565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:46.081175 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:46.081175 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:46.158829 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:46.160056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:46.260745 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 587/1171] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:46.268817 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79eeb0-54fb-4cf6-bcf2-ef8d93826130 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:46.269356 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79eeb0-54fb-4cf6-bcf2-ef8d93826130 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:46.269356 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79eeb0-54fb-4cf6-bcf2-ef8d93826130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:46.347486 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-5f79eeb0-54fb-4cf6-bcf2-ef8d93826130 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:46.348639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-5f79eeb0-54fb-4cf6-bcf2-ef8d93826130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:46.449594 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 585/1172] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:46.454369 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:46.455583 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:46.468843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e968c3-ace7-4598-95a4-47da9fdb4cc2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:46.532251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:46.566542 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:46.567161 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:46.567443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:46.567715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:46.568421 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:53:46.568751 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:46.569801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:53:46.569801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:53:46.569801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:53:46.571249 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:46.583516 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 588/1173] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 16 00:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:53:46.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79eeb0-54fb-4cf6-bcf2-ef8d93826130 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:46.603632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79eeb0-54fb-4cf6-bcf2-ef8d93826130 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:46.666195 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:46.701217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:46.701822 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:46.702102 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:46.702376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:46.703024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:46.704133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING py.warnings [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:53:46.704133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: warnings.warn(msg) Oct 16 00:53:46.704133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: Oct 16 00:53:46.705355 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:46.765454 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 586/1174] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 16 00:53:46 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:53:46.770518 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:46.772137 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:46.809908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958cfbe-ea07-4fa5-8e8a-218614f1b85b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:46.910733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:46.911253 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:46.911533 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:46.911807 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:46.912487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:46.913508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:53:46.913508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:53:46.913508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:53:46.914826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:46.958785 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 589/1175] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:53:46 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:53:46.963586 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:46.965190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:47.027582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0941fc3-f55b-4457-9531-3da95a754404 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:47.112992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:47.125934 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:47.126551 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:47.126835 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:47.127112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:47.127762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:47.129446 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:47.142252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 587/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:53:47.146231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:47.147807 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:47.159726 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3b55-1e5b-440a-b7d3-d6cc70dd58a3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:47.186729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:47.261999 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1201fac-c9f7-4deb-a454-89bba54ee025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:47.262614 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201fac-c9f7-4deb-a454-89bba54ee025 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:47.262896 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201fac-c9f7-4deb-a454-89bba54ee025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:47.263179 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201fac-c9f7-4deb-a454-89bba54ee025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:47.263827 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1201fac-c9f7-4deb-a454-89bba54ee025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:47.265475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1201fac-c9f7-4deb-a454-89bba54ee025 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:47.278289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 590/1177] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:53:47.282572 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:47.284117 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:47.319601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513a11-f60c-4d27-9afb-188c3835c1a3 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:47.417043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe915b4-8892-40d9-a15e-7a29ffc4954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:47.417713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe915b4-8892-40d9-a15e-7a29ffc4954b admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:47.418107 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe915b4-8892-40d9-a15e-7a29ffc4954b admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:47.418384 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe915b4-8892-40d9-a15e-7a29ffc4954b admin admin] PATH_INFO: `/v3/projects/8e1d34293ea546839c95aabbebdd3168/users/8b63d23e1b384ddca131fb66420f070e/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:47.443150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe915b4-8892-40d9-a15e-7a29ffc4954b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1d34293ea546839c95aabbebdd3168, user_id=8b63d23e1b384ddca131fb66420f070e, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:47.446200 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe915b4-8892-40d9-a15e-7a29ffc4954b admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:47.474171 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 588/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 16 00:53:47 2022] PUT /identity/v3/projects/8e1d34293ea546839c95aabbebdd3168/users/8b63d23e1b384ddca131fb66420f070e/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:53:47.486232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67265e-22ff-4866-981d-8ec90188b4dd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:47.486521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67265e-22ff-4866-981d-8ec90188b4dd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:47.486801 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67265e-22ff-4866-981d-8ec90188b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:47.546763 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7c67265e-22ff-4866-981d-8ec90188b4dd None None] MFA Rules not processed for user `8b63d23e1b384ddca131fb66420f070e`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:47.547981 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7c67265e-22ff-4866-981d-8ec90188b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:47.628648 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 591/1179] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:53:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:47.641942 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311161-01ce-40fb-9080-4a88a73acabf None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:47.642227 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311161-01ce-40fb-9080-4a88a73acabf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:47.642522 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311161-01ce-40fb-9080-4a88a73acabf None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:47.643855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 589/1180] 10.222.0.23 () {54 vars in 963 bytes} [Sun Oct 16 00:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:47.649147 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6368c6-2615-47ad-a831-7b0563dfff10 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:47.649439 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6368c6-2615-47ad-a831-7b0563dfff10 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:47.649721 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6368c6-2615-47ad-a831-7b0563dfff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:47.682055 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:47.726621 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7f6368c6-2615-47ad-a831-7b0563dfff10 None None] MFA Rules not processed for user `e94eb5478e41472abf39001b01db4ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:47.727742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7f6368c6-2615-47ad-a831-7b0563dfff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:47.804656 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 592/1181] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 16 00:53:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:47.814190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d311161-01ce-40fb-9080-4a88a73acabf None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:47.815832 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9d311161-01ce-40fb-9080-4a88a73acabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:47.870508 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:47.945630 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d311161-01ce-40fb-9080-4a88a73acabf None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:48.019660 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94eb5478e41472abf39001b01db4ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:48.020171 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:48.020501 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:48.020781 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:48.022446 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:48.122351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:48.123806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:48.127332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:48.143214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 590/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:48.190883 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a851-7a62-447d-a68d-e718965b8486 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:48.191294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a851-7a62-447d-a68d-e718965b8486 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:48.191443 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a851-7a62-447d-a68d-e718965b8486 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:48.192762 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 593/1183] 10.222.0.23 () {52 vars in 830 bytes} [Sun Oct 16 00:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:48.197383 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:48.198638 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:48.299123 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89fb3b-5a14-4322-b761-f7b7cb80958e service cinder] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:48.395523 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:48.396150 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:48.396466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:48.396741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] PATH_INFO: `/v3/users/8b63d23e1b384ddca131fb66420f070e` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:48.412365 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b63d23e1b384ddca131fb66420f070e)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:48.413417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING py.warnings [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:53:48.413417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: warnings.warn(msg) Oct 16 00:53:48.413417 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: Oct 16 00:53:48.415368 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:48.425994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=100 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:48.484212 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b63d23e1b384ddca131fb66420f070e'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:48.494774 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b63d23e1b384ddca131fb66420f070e'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:48.495307 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b63d23e1b384ddca131fb66420f070e'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:48.510883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b63d23e1b384ddca131fb66420f070e'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:48.511357 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b63d23e1b384ddca131fb66420f070e'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:48.541495 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 591/1184] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 16 00:53:48 2022] DELETE /identity/v3/users/8b63d23e1b384ddca131fb66420f070e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:53:48.546074 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:48.546374 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:48.546643 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:48.610247 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:48.611372 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:48.688604 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:48.702943 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 594/1185] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:48.714569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:48.715807 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:48.817509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207f05-8a09-4dbb-9812-e54edbe4b2ee admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:48.875293 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:48.896457 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4549f-206f-442e-8060-f6475fb62371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:48.897074 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4549f-206f-442e-8060-f6475fb62371 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:48.897358 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4549f-206f-442e-8060-f6475fb62371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:48.897631 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4549f-206f-442e-8060-f6475fb62371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:48.899580 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-13d4549f-206f-442e-8060-f6475fb62371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:49.013253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4549f-206f-442e-8060-f6475fb62371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:49.014706 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4549f-206f-442e-8060-f6475fb62371 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:49.036080 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 592/1186] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:49.405741 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:49.407026 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:49.419593 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba4131-26c6-42b8-bea9-5df479da41dd None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:49.524425 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:49.525068 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:49.525351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:49.525625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] PATH_INFO: `/v3/projects/8e1d34293ea546839c95aabbebdd3168` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:49.535704 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1d34293ea546839c95aabbebdd3168)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:49.536757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:53:49.536757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:53:49.536757 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:53:49.537967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:49.597387 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1d34293ea546839c95aabbebdd3168', 'request_id': 'req-a2c5bf27-f2a1-4897-8a78-1594af6d0005'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:49.611848 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1d34293ea546839c95aabbebdd3168', 'request_id': 'req-a2c5bf27-f2a1-4897-8a78-1594af6d0005'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:49.618155 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1d34293ea546839c95aabbebdd3168', 'request_id': 'req-a2c5bf27-f2a1-4897-8a78-1594af6d0005'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:49.646734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] The token cache is being invalidate because project 8e1d34293ea546839c95aabbebdd3168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:53:49.647022 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:49.647511 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a2c5bf27-f2a1-4897-8a78-1594af6d0005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:53:49.650097 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 595/1187] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 16 00:53:49 2022] DELETE /identity/v3/projects/8e1d34293ea546839c95aabbebdd3168 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:53:59.033836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=62 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:59.644714 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:03.689280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30621-0cd3-4be4-a321-6e131e7f68cd None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:03.689904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30621-0cd3-4be4-a321-6e131e7f68cd None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:03.689904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30621-0cd3-4be4-a321-6e131e7f68cd None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:03.691190 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 593/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:03.696013 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df90ca-3f82-4d0f-a33c-17aa20fc32c1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:03.696496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df90ca-3f82-4d0f-a33c-17aa20fc32c1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:03.696595 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df90ca-3f82-4d0f-a33c-17aa20fc32c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:03.778063 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e8df90ca-3f82-4d0f-a33c-17aa20fc32c1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:03.779285 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e8df90ca-3f82-4d0f-a33c-17aa20fc32c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:03.887272 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 596/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:04.045692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30621-0cd3-4be4-a321-6e131e7f68cd None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:04.047801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-0ae30621-0cd3-4be4-a321-6e131e7f68cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:04.165182 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30621-0cd3-4be4-a321-6e131e7f68cd None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:04.171951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d2f4f-ddae-4f78-b220-4eef35fc8899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:04.172597 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2f4f-ddae-4f78-b220-4eef35fc8899 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:04.172893 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2f4f-ddae-4f78-b220-4eef35fc8899 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:04.173152 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2f4f-ddae-4f78-b220-4eef35fc8899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:04.181717 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d2f4f-ddae-4f78-b220-4eef35fc8899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:04.184014 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d2f4f-ddae-4f78-b220-4eef35fc8899 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:04.196233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 594/1190] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:05.274875 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db63dc-dbeb-40bd-a487-35b3c5b05400 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:05.275399 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db63dc-dbeb-40bd-a487-35b3c5b05400 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:05.275567 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db63dc-dbeb-40bd-a487-35b3c5b05400 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:05.277213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 597/1191] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:05.283382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb8d4-a7ed-4b98-b837-f029c94a8b75 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:05.283834 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb8d4-a7ed-4b98-b837-f029c94a8b75 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:05.283951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb8d4-a7ed-4b98-b837-f029c94a8b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:05.303431 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-f40cb8d4-a7ed-4b98-b837-f029c94a8b75 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:05.304682 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-f40cb8d4-a7ed-4b98-b837-f029c94a8b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:05.313143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 595/1192] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:05.463892 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db63dc-dbeb-40bd-a487-35b3c5b05400 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:05.479605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db63dc-dbeb-40bd-a487-35b3c5b05400 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:05.485937 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f13e5-c632-4f65-9b6b-bfef60f2459c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:05.486540 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f13e5-c632-4f65-9b6b-bfef60f2459c service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:05.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f13e5-c632-4f65-9b6b-bfef60f2459c service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:05.487089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f13e5-c632-4f65-9b6b-bfef60f2459c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:05.495042 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f13e5-c632-4f65-9b6b-bfef60f2459c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:05.497289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f13e5-c632-4f65-9b6b-bfef60f2459c service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:05.506484 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 598/1193] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:08.268569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e05f-3787-41fb-9d26-710c31e98361 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:08.269145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e05f-3787-41fb-9d26-710c31e98361 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:08.269145 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e05f-3787-41fb-9d26-710c31e98361 None None] PATH_INFO: `/v3` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:08.270404 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 596/1194] 10.222.0.26 () {54 vars in 925 bytes} [Sun Oct 16 00:55:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:08.276856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea34b5d-d47c-4694-9ee8-04312e893075 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:08.277448 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea34b5d-d47c-4694-9ee8-04312e893075 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:08.277806 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea34b5d-d47c-4694-9ee8-04312e893075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:08.340880 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fea34b5d-d47c-4694-9ee8-04312e893075 None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:08.342254 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fea34b5d-d47c-4694-9ee8-04312e893075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:08.359934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:08.418880 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 599/1195] 10.222.0.26 () {58 vars in 1015 bytes} [Sun Oct 16 00:55:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:15.299128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=56 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:16.881603 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5bdd-9dc1-4b65-abd2-ec8e0678db7f None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:16.882214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5bdd-9dc1-4b65-abd2-ec8e0678db7f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:16.882214 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5bdd-9dc1-4b65-abd2-ec8e0678db7f None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:16.883502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 597/1196] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 16 00:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:16.889206 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629799-fd2d-4120-a9cb-faf800875247 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:16.889697 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629799-fd2d-4120-a9cb-faf800875247 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:16.889802 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629799-fd2d-4120-a9cb-faf800875247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:16.911809 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ff629799-fd2d-4120-a9cb-faf800875247 None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:16.913373 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ff629799-fd2d-4120-a9cb-faf800875247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:16.922617 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 600/1197] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 16 00:55:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:16.930324 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5bdd-9dc1-4b65-abd2-ec8e0678db7f None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:16.944297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5bdd-9dc1-4b65-abd2-ec8e0678db7f None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:16.950175 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400864b-d4e0-4134-8bdb-ffde12354550 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:16.950789 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400864b-d4e0-4134-8bdb-ffde12354550 service placement] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:16.951103 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400864b-d4e0-4134-8bdb-ffde12354550 service placement] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:16.951378 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400864b-d4e0-4134-8bdb-ffde12354550 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:16.963029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400864b-d4e0-4134-8bdb-ffde12354550 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:16.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400864b-d4e0-4134-8bdb-ffde12354550 service placement] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:16.975647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 598/1198] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:17.004379 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df5aa-343f-4380-a5d4-8f3279e08b82 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:17.004673 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df5aa-343f-4380-a5d4-8f3279e08b82 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:17.004998 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df5aa-343f-4380-a5d4-8f3279e08b82 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:17.006328 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 601/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:17.013678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1bbf-6c0e-41e6-90a6-7b431e54dcc2 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:17.013990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1bbf-6c0e-41e6-90a6-7b431e54dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:17.014317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1bbf-6c0e-41e6-90a6-7b431e54dcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:17.034651 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-18ec1bbf-6c0e-41e6-90a6-7b431e54dcc2 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:17.035870 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-18ec1bbf-6c0e-41e6-90a6-7b431e54dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:17.045690 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 599/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:55:17.202643 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df5aa-343f-4380-a5d4-8f3279e08b82 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:17.217778 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df5aa-343f-4380-a5d4-8f3279e08b82 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:17.223271 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86684d0-9039-4c66-b5d6-a42fa1fa96c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:17.223881 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86684d0-9039-4c66-b5d6-a42fa1fa96c8 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:17.224158 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86684d0-9039-4c66-b5d6-a42fa1fa96c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:17.224466 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86684d0-9039-4c66-b5d6-a42fa1fa96c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:17.233306 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86684d0-9039-4c66-b5d6-a42fa1fa96c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:17.235016 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86684d0-9039-4c66-b5d6-a42fa1fa96c8 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:17.244707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 602/1201] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:18.376860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba587bc-9b93-4a52-80a3-a3efcee1d249 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:18.377421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba587bc-9b93-4a52-80a3-a3efcee1d249 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:18.377421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba587bc-9b93-4a52-80a3-a3efcee1d249 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:18.378736 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 600/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:18.385052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ecdb9-e50c-40c0-8211-13ac49eb9fb0 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:18.386127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ecdb9-e50c-40c0-8211-13ac49eb9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:18.386127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ecdb9-e50c-40c0-8211-13ac49eb9fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:18.406039 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-cd3ecdb9-e50c-40c0-8211-13ac49eb9fb0 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:18.407260 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cd3ecdb9-e50c-40c0-8211-13ac49eb9fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:18.415279 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 603/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:18.567796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba587bc-9b93-4a52-80a3-a3efcee1d249 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:18.582603 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba587bc-9b93-4a52-80a3-a3efcee1d249 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:18.588148 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557688-2b59-4821-b097-c5710349997b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:18.588826 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557688-2b59-4821-b097-c5710349997b service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:18.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557688-2b59-4821-b097-c5710349997b service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:18.589366 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557688-2b59-4821-b097-c5710349997b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:18.597147 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78557688-2b59-4821-b097-c5710349997b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:18.598714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78557688-2b59-4821-b097-c5710349997b service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:18.608000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 601/1204] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:22.759117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c541-047a-4cf1-ab14-8dc3406983ac None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:22.759694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c541-047a-4cf1-ab14-8dc3406983ac None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:22.759694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c541-047a-4cf1-ab14-8dc3406983ac None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:22.761934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 604/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:22.767296 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841a19e-74a6-490f-a296-3ff7462f5491 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:22.767718 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841a19e-74a6-490f-a296-3ff7462f5491 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:22.767830 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841a19e-74a6-490f-a296-3ff7462f5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:22.787449 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-9841a19e-74a6-490f-a296-3ff7462f5491 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:22.788665 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9841a19e-74a6-490f-a296-3ff7462f5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:22.796448 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 602/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:55:23.091064 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7c541-047a-4cf1-ab14-8dc3406983ac None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:23.092740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-20a7c541-047a-4cf1-ab14-8dc3406983ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:23.169409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7c541-047a-4cf1-ab14-8dc3406983ac None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:23.172989 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65e8b5-5807-43d6-bdda-010091a3b6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:23.173596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65e8b5-5807-43d6-bdda-010091a3b6cd service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:23.173876 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65e8b5-5807-43d6-bdda-010091a3b6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:23.174148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65e8b5-5807-43d6-bdda-010091a3b6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:23.183648 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65e8b5-5807-43d6-bdda-010091a3b6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:23.185104 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65e8b5-5807-43d6-bdda-010091a3b6cd service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:23.194370 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 605/1207] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:25.369087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17d5c-666d-414d-a205-0c6a970d9f17 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:25.370181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17d5c-666d-414d-a205-0c6a970d9f17 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:25.370181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17d5c-666d-414d-a205-0c6a970d9f17 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:25.371505 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 603/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:25.377245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84579-160c-451e-b8fa-f4020ee40cf4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:25.377814 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84579-160c-451e-b8fa-f4020ee40cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:25.377814 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84579-160c-451e-b8fa-f4020ee40cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:25.398009 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2fe84579-160c-451e-b8fa-f4020ee40cf4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:25.399200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2fe84579-160c-451e-b8fa-f4020ee40cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:25.407430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 606/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:25.703160 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17d5c-666d-414d-a205-0c6a970d9f17 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:25.714762 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17d5c-666d-414d-a205-0c6a970d9f17 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:25.718362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bac7a9-b552-4c5a-9a67-c792434d1cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:25.718994 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac7a9-b552-4c5a-9a67-c792434d1cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:25.719269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac7a9-b552-4c5a-9a67-c792434d1cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:25.719540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac7a9-b552-4c5a-9a67-c792434d1cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:25.728751 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bac7a9-b552-4c5a-9a67-c792434d1cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:25.730233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bac7a9-b552-4c5a-9a67-c792434d1cc5 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:25.739797 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 604/1210] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:29.537108 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afa382-dfd6-4f26-a3c9-f2d113035d96 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:29.539044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afa382-dfd6-4f26-a3c9-f2d113035d96 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:29.539044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afa382-dfd6-4f26-a3c9-f2d113035d96 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:29.539258 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 607/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:29.545741 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8eb87-d5a0-46f1-b964-e9aebf952934 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:29.546291 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8eb87-d5a0-46f1-b964-e9aebf952934 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:29.546407 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8eb87-d5a0-46f1-b964-e9aebf952934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:29.567031 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-a7a8eb87-d5a0-46f1-b964-e9aebf952934 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:29.568231 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a7a8eb87-d5a0-46f1-b964-e9aebf952934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:29.576127 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 605/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:29.899470 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afa382-dfd6-4f26-a3c9-f2d113035d96 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:29.901930 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-12afa382-dfd6-4f26-a3c9-f2d113035d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:29.971940 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:29.987085 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afa382-dfd6-4f26-a3c9-f2d113035d96 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:29.990822 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10d252-054e-4f9d-8a01-a8c819167343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94eb5478e41472abf39001b01db4ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:29.991441 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10d252-054e-4f9d-8a01-a8c819167343 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:29.991728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10d252-054e-4f9d-8a01-a8c819167343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:29.992008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10d252-054e-4f9d-8a01-a8c819167343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:30.002521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10d252-054e-4f9d-8a01-a8c819167343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:30.003967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10d252-054e-4f9d-8a01-a8c819167343 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:30.014592 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 608/1213] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:32.192572 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e966e-bb19-4d8e-9a3b-490b514325a4 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:32.193349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e966e-bb19-4d8e-9a3b-490b514325a4 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:32.193349 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e966e-bb19-4d8e-9a3b-490b514325a4 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:32.194355 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 606/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:55:32.200255 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162143-2d94-4cb2-971c-2262e0e7c59e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:32.200816 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162143-2d94-4cb2-971c-2262e0e7c59e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:32.200920 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162143-2d94-4cb2-971c-2262e0e7c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:32.221222 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-8b162143-2d94-4cb2-971c-2262e0e7c59e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:32.222430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8b162143-2d94-4cb2-971c-2262e0e7c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:32.231070 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 609/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:32.536606 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e966e-bb19-4d8e-9a3b-490b514325a4 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:32.538355 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-ff9e966e-bb19-4d8e-9a3b-490b514325a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:32.551878 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e966e-bb19-4d8e-9a3b-490b514325a4 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:32.555436 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5fc67-c6ac-43a2-bf9b-a8d9ef0ccb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e94eb5478e41472abf39001b01db4ae6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:32.556029 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5fc67-c6ac-43a2-bf9b-a8d9ef0ccb12 service cinder] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:32.556329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5fc67-c6ac-43a2-bf9b-a8d9ef0ccb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:32.556624 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5fc67-c6ac-43a2-bf9b-a8d9ef0ccb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:32.566466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5fc67-c6ac-43a2-bf9b-a8d9ef0ccb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:32.568130 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5fc67-c6ac-43a2-bf9b-a8d9ef0ccb12 service cinder] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:32.579627 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 607/1216] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:55:42.216184 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=11 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:42.576540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=33 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.419985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493c35c-d92a-4246-af3f-0ef49b367e9e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.420609 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493c35c-d92a-4246-af3f-0ef49b367e9e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.420609 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493c35c-d92a-4246-af3f-0ef49b367e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.441215 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6493c35c-d92a-4246-af3f-0ef49b367e9e None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.442406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6493c35c-d92a-4246-af3f-0ef49b367e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.450733 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 610/1217] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:50.460157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73f2d-0d64-492c-a499-cb36fbd7fefc None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.460729 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73f2d-0d64-492c-a499-cb36fbd7fefc None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.460729 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73f2d-0d64-492c-a499-cb36fbd7fefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.480936 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-efa73f2d-0d64-492c-a499-cb36fbd7fefc None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.482133 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-efa73f2d-0d64-492c-a499-cb36fbd7fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.482980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a236d-af0f-49a3-bbe6-aa106bd9b1c4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.483270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a236d-af0f-49a3-bbe6-aa106bd9b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.483542 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a236d-af0f-49a3-bbe6-aa106bd9b1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.490173 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 608/1218] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:50.495810 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa73f2d-0d64-492c-a499-cb36fbd7fefc None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.504550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa73f2d-0d64-492c-a499-cb36fbd7fefc None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.505697 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9a6a236d-af0f-49a3-bbe6-aa106bd9b1c4 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.506909 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9a6a236d-af0f-49a3-bbe6-aa106bd9b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.509727 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.510334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.510615 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.510883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] PATH_INFO: `/v3/domains` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.511512 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:50.511815 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.512921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING py.warnings [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:56:50.512921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: warnings.warn(msg) Oct 16 00:56:50.512921 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: Oct 16 00:56:50.513726 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.515342 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 611/1219] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:50.524565 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9011ef7-7870-4d1e-985a-d9f1925306f1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.524853 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9011ef7-7870-4d1e-985a-d9f1925306f1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.525131 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9011ef7-7870-4d1e-985a-d9f1925306f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.526189 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 609/1220] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:56:50.534001 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.544611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69657a-c22f-4826-b976-cb0a473e1706 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.545564 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f9011ef7-7870-4d1e-985a-d9f1925306f1 None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.546758 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f9011ef7-7870-4d1e-985a-d9f1925306f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.549388 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.549990 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.550397 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.550677 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.551311 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.553253 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.555464 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 612/1221] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:50.559950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9011ef7-7870-4d1e-985a-d9f1925306f1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.568993 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9011ef7-7870-4d1e-985a-d9f1925306f1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.573981 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.574587 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.574910 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.575267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.575945 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:50.576418 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.578087 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.590852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 613/1222] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:56:50.595937 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 610/1223] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:50.597339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.598591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.608624 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de478c46-635e-4683-bc28-487d5145c9ca admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.662399 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d2710-3098-47ab-bb2c-1f886904981d admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.667710 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.668334 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.668635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.668909 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.669550 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.670319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.670936 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.671250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.671451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.671564 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.672152 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.674150 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.700485 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 614/1224] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:50.701954 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 611/1225] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:50.703447 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.706559 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.714411 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f1be0-f8ac-4691-a747-57c9aed8e6c3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.773809 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.774064 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291cf97-50b8-4767-90d8-2e753199ba0b admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.774574 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.774823 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.775096 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.775739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.777406 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.778703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.779676 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.779676 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.779883 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.780518 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.781534 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: WARNING py.warnings [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:56:50.781534 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: warnings.warn(msg) Oct 16 00:56:50.781534 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: Oct 16 00:56:50.782753 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.787537 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 615/1226] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:50.793044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.803762 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb780c-7629-49f3-9d9e-0616a0f20324 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.805144 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 612/1227] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:50.809267 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.809419 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.809885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.810165 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.810441 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.811078 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.812700 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.819159 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbd3f4-c860-42bb-a68d-4ddd43faf88f admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.824494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.825101 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.825385 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.825663 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.826625 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 616/1228] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:50.830084 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.830084 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.831021 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.842958 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 613/1229] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:50.843171 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d937e1-8d82-4f21-b103-4ca099917cf5 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.843985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.847244 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5c9c6-6d59-43f6-9011-fa98f33e18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.847904 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c9c6-6d59-43f6-9011-fa98f33e18ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.848183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c9c6-6d59-43f6-9011-fa98f33e18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.848498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c9c6-6d59-43f6-9011-fa98f33e18ce admin admin] PATH_INFO: `/v3/projects/8e2ea3f2089d47fe921d37f90a266b52/users/70c70e6c976e47649fc6a279e3eb60d7/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.855236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f08a5-4058-477f-9a98-03ff9b6a3c75 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.859936 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.860575 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.860856 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.861131 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.861773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.863387 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.864363 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5c9c6-6d59-43f6-9011-fa98f33e18ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2ea3f2089d47fe921d37f90a266b52, user_id=70c70e6c976e47649fc6a279e3eb60d7, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.867036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5c9c6-6d59-43f6-9011-fa98f33e18ce admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.874062 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 614/1230] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:50.878362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.883595 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.883772 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 617/1231] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:50 2022] PUT /identity/v3/projects/8e2ea3f2089d47fe921d37f90a266b52/users/70c70e6c976e47649fc6a279e3eb60d7/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:50.888913 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee6625-204f-4713-b6be-15fc8bac881a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.889200 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee6625-204f-4713-b6be-15fc8bac881a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.889475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee6625-204f-4713-b6be-15fc8bac881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.889591 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3353c-4850-42ba-bf43-add1ba5f9aba admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.912251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-adee6625-204f-4713-b6be-15fc8bac881a None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.914713 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-adee6625-204f-4713-b6be-15fc8bac881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.926759 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.952608 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed228b4-21b7-4a1e-9ebf-674dc561db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.953287 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed228b4-21b7-4a1e-9ebf-674dc561db25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.953569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed228b4-21b7-4a1e-9ebf-674dc561db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.953851 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed228b4-21b7-4a1e-9ebf-674dc561db25 admin admin] PATH_INFO: `/v3/projects/901562bad87f43dcac6dfb7d16d40e95/users/e2ee042400a344abbcb0e8bd6f4303f3/roles/3dbfca88f6e14b6dbd68ed1234f982bd` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.977499 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed228b4-21b7-4a1e-9ebf-674dc561db25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901562bad87f43dcac6dfb7d16d40e95, user_id=e2ee042400a344abbcb0e8bd6f4303f3, role_id=3dbfca88f6e14b6dbd68ed1234f982bd)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.979585 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 618/1232] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:50.980585 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed228b4-21b7-4a1e-9ebf-674dc561db25 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.990381 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee6625-204f-4713-b6be-15fc8bac881a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.994211 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 615/1233] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:50 2022] PUT /identity/v3/projects/901562bad87f43dcac6dfb7d16d40e95/users/e2ee042400a344abbcb0e8bd6f4303f3/roles/3dbfca88f6e14b6dbd68ed1234f982bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:50.999230 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6331-5119-4661-a250-66ce30fb727f None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.999527 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6331-5119-4661-a250-66ce30fb727f None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.999804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6331-5119-4661-a250-66ce30fb727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:51.019030 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-0cfd6331-5119-4661-a250-66ce30fb727f None None] MFA Rules not processed for user `39d9127a36484f1999634ad75717a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:51.020259 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-0cfd6331-5119-4661-a250-66ce30fb727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:51.051174 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee6625-204f-4713-b6be-15fc8bac881a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:51.083980 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 616/1234] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:51.096061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd6331-5119-4661-a250-66ce30fb727f None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:51.105244 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cacb8c-1ad9-4999-979f-59c8248845a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:51.105924 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cacb8c-1ad9-4999-979f-59c8248845a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:51.106189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cacb8c-1ad9-4999-979f-59c8248845a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:51.106462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cacb8c-1ad9-4999-979f-59c8248845a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:51.115762 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cacb8c-1ad9-4999-979f-59c8248845a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:51.117289 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cacb8c-1ad9-4999-979f-59c8248845a4 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:51.127156 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 619/1235] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:51.154724 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd6331-5119-4661-a250-66ce30fb727f None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:51.158582 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:51.159273 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:51.159728 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:51.160011 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:51.170143 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:51.171703 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:51.182852 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 617/1236] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:56.279615 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb47c3-9a11-4bb4-98be-daff68cfa8a4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.280062 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb47c3-9a11-4bb4-98be-daff68cfa8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.280385 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb47c3-9a11-4bb4-98be-daff68cfa8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.365269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-00bb47c3-9a11-4bb4-98be-daff68cfa8a4 None None] MFA Rules not processed for user `70c70e6c976e47649fc6a279e3eb60d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:56.367255 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-00bb47c3-9a11-4bb4-98be-daff68cfa8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.479468 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 620/1237] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:56.481635 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.505010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518758-4591-4695-ab52-c71b90bf076d service neutron] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.517354 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.518331 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.518769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.519283 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.520139 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.524492 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.576306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 618/1238] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:56 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:56.579701 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb47c3-9a11-4bb4-98be-daff68cfa8a4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.606578 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb47c3-9a11-4bb4-98be-daff68cfa8a4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.617339 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:56.704847 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.705832 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.706260 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.706729 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.708417 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.711995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.746428 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 621/1239] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:56 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:56.750996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.766257 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be38e5-8934-4b15-bbff-77c792106458 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.773054 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.774496 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.774792 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.775068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.776157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.780953 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:56.805064 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 619/1240] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:56.808885 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.823557 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88bfb-5248-4303-b21b-9eba0560154f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.840765 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.841491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.841779 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.842056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] PATH_INFO: `/v3/projects/ac2c743cd8724a44b85eeeac25b59d9e/users/4b2b714e88544867af3d4d2b080523dd/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.864594 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2c743cd8724a44b85eeeac25b59d9e, user_id=4b2b714e88544867af3d4d2b080523dd, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.871488 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.896920 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 622/1241] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:56 2022] PUT /identity/v3/projects/ac2c743cd8724a44b85eeeac25b59d9e/users/4b2b714e88544867af3d4d2b080523dd/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:56.901535 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.917308 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84e810-bfe6-4712-b296-a0f5b820ba58 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.995273 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b8236-7ec0-4541-8935-0d3b2ed3f2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.995917 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8236-7ec0-4541-8935-0d3b2ed3f2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.996258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8236-7ec0-4541-8935-0d3b2ed3f2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.996554 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8236-7ec0-4541-8935-0d3b2ed3f2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.997233 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b8236-7ec0-4541-8935-0d3b2ed3f2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.998929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b8236-7ec0-4541-8935-0d3b2ed3f2e6 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.014941 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 620/1242] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:57.015740 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.028789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b6c3-5b31-4fe4-80a9-dfba206b59b0 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.037538 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.038266 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.038772 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.039109 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] PATH_INFO: `/v3/projects/ac2c743cd8724a44b85eeeac25b59d9e/users/4b2b714e88544867af3d4d2b080523dd/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.046688 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2c743cd8724a44b85eeeac25b59d9e, user_id=4b2b714e88544867af3d4d2b080523dd, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.049440 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.074855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 623/1243] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:57 2022] PUT /identity/v3/projects/ac2c743cd8724a44b85eeeac25b59d9e/users/4b2b714e88544867af3d4d2b080523dd/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:57.517715 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d5c3c-9d36-4aa5-a1b9-9b78c081739c None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.518258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d5c3c-9d36-4aa5-a1b9-9b78c081739c None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.518258 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d5c3c-9d36-4aa5-a1b9-9b78c081739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.550001 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-9d9d5c3c-9d36-4aa5-a1b9-9b78c081739c None None] MFA Rules not processed for user `e2ee042400a344abbcb0e8bd6f4303f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:57.551246 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9d9d5c3c-9d36-4aa5-a1b9-9b78c081739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:57.633081 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 621/1244] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:57.637953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.878609 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ed790-7820-4b2b-abbb-182524754619 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.884438 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.885076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.885353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.886106 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.887292 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.889611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: WARNING py.warnings [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:56:57.889611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: warnings.warn(msg) Oct 16 00:56:57.889611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: Oct 16 00:56:57.891183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.935967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 624/1245] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:57.940914 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d5c3c-9d36-4aa5-a1b9-9b78c081739c None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.954317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d5c3c-9d36-4aa5-a1b9-9b78c081739c None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.030964 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.031697 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.031983 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.032262 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] PATH_INFO: `/v3/users` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.032984 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.035151 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.067276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 622/1246] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:58.072100 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.083549 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be2b73-e017-4129-99a8-5c6af7f0dcc3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.090966 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.091473 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.091758 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.092032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.095183 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.099089 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.125430 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 625/1247] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:58.127742 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.142836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a4ee3-8814-4cf1-b007-43049865e44a admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.161802 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.162584 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.162980 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.163344 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] PATH_INFO: `/v3/projects/a9224baaf1b54b29acd25794117e3a24/users/4ad9f3e393a2491da671024203c54e43/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.183053 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:58.201516 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9224baaf1b54b29acd25794117e3a24, user_id=4ad9f3e393a2491da671024203c54e43, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.204474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.235140 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 623/1248] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:58 2022] PUT /identity/v3/projects/a9224baaf1b54b29acd25794117e3a24/users/4ad9f3e393a2491da671024203c54e43/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:58.237223 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.254648 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d455ce-e780-4afd-871c-04db62c39ea6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.297118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:58.359307 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17d421-1bd0-4499-8f4e-b633adcd54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.360353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17d421-1bd0-4499-8f4e-b633adcd54c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.360856 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17d421-1bd0-4499-8f4e-b633adcd54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.361498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17d421-1bd0-4499-8f4e-b633adcd54c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.362465 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17d421-1bd0-4499-8f4e-b633adcd54c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.364494 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17d421-1bd0-4499-8f4e-b633adcd54c0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.379232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 626/1249] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:58.383219 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.400087 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36a611-e478-4d23-8854-9e2501edeaa6 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.417920 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.418882 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.419343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.420068 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] PATH_INFO: `/v3/projects/a9224baaf1b54b29acd25794117e3a24/users/4ad9f3e393a2491da671024203c54e43/roles/9622bc515e36436ba412f5f88df3dcf0` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.427957 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9224baaf1b54b29acd25794117e3a24, user_id=4ad9f3e393a2491da671024203c54e43, role_id=9622bc515e36436ba412f5f88df3dcf0)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.431089 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.460538 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 624/1250] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:58 2022] PUT /identity/v3/projects/a9224baaf1b54b29acd25794117e3a24/users/4ad9f3e393a2491da671024203c54e43/roles/9622bc515e36436ba412f5f88df3dcf0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:03.994480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0443a-00ac-47a9-866a-8643253e169d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.995056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0443a-00ac-47a9-866a-8643253e169d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.995056 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0443a-00ac-47a9-866a-8643253e169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.045118 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-48a0443a-00ac-47a9-866a-8643253e169d None None] MFA Rules not processed for user `4b2b714e88544867af3d4d2b080523dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:04.048384 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-48a0443a-00ac-47a9-866a-8643253e169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.195251 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 627/1251] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:04.207902 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:04.212479 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.370045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1a63-f507-4c5d-a8fb-11d28b96c5e1 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:04.379197 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee1f9-3c90-4a88-b6cd-f618d6a6135d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18da5473168d4998bb38de305174819c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:04.383545 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee1f9-3c90-4a88-b6cd-f618d6a6135d service glance] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.383832 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee1f9-3c90-4a88-b6cd-f618d6a6135d service glance] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.384110 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee1f9-3c90-4a88-b6cd-f618d6a6135d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.499791 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee1f9-3c90-4a88-b6cd-f618d6a6135d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:04.501481 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee1f9-3c90-4a88-b6cd-f618d6a6135d service glance] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:04.517329 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 625/1252] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:04.835799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc09d-889c-4feb-8e60-21b8a35faf2f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.836237 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc09d-889c-4feb-8e60-21b8a35faf2f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.836662 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc09d-889c-4feb-8e60-21b8a35faf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.937508 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a6efc09d-889c-4feb-8e60-21b8a35faf2f None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:04.941659 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a6efc09d-889c-4feb-8e60-21b8a35faf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.044157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068875-2baf-4adf-95c0-78777042476b None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.044487 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068875-2baf-4adf-95c0-78777042476b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.044769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068875-2baf-4adf-95c0-78777042476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.094239 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-16068875-2baf-4adf-95c0-78777042476b None None] MFA Rules not processed for user `4ad9f3e393a2491da671024203c54e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:05.095488 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-16068875-2baf-4adf-95c0-78777042476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.103608 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 628/1253] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:05.259250 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:05.285611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 626/1254] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:05.303349 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc09d-889c-4feb-8e60-21b8a35faf2f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:05.314255 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068875-2baf-4adf-95c0-78777042476b None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:05.315710 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-16068875-2baf-4adf-95c0-78777042476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.316992 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc09d-889c-4feb-8e60-21b8a35faf2f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:05.322327 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b4786-54e3-4094-b0d6-2865ab9c1e0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18da5473168d4998bb38de305174819c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:05.323265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b4786-54e3-4094-b0d6-2865ab9c1e0a service glance] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.323735 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b4786-54e3-4094-b0d6-2865ab9c1e0a service glance] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.324225 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b4786-54e3-4094-b0d6-2865ab9c1e0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.358318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:05.416720 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b4786-54e3-4094-b0d6-2865ab9c1e0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:05.418546 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b4786-54e3-4094-b0d6-2865ab9c1e0a service glance] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:05.431938 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 629/1255] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:05.456388 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068875-2baf-4adf-95c0-78777042476b None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:05.467951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:05.468574 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.468864 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.469306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.480205 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:05.481905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:05.504622 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 627/1256] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 00:57:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 00:57:07.354931 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3276f5-c57a-41c8-9761-951f65152fd6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.357270 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3276f5-c57a-41c8-9761-951f65152fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3276f5-c57a-41c8-9761-951f65152fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.392365 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0c3276f5-c57a-41c8-9761-951f65152fd6 None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:07.394324 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0c3276f5-c57a-41c8-9761-951f65152fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:07.412613 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 630/1257] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:57:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:07.424502 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.460674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824ced-c4d4-458a-b25b-6e62dcc43cbc service swift] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.470521 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d1d6-6c05-47bf-aa0b-8fe49ed6471d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.471859 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d1d6-6c05-47bf-aa0b-8fe49ed6471d service swift] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.474780 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d1d6-6c05-47bf-aa0b-8fe49ed6471d service swift] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.475616 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d1d6-6c05-47bf-aa0b-8fe49ed6471d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.494138 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d1d6-6c05-47bf-aa0b-8fe49ed6471d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.501768 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d1d6-6c05-47bf-aa0b-8fe49ed6471d service swift] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.525163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 628/1258] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 00:57:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:57:17.385598 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=19 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:17.513069 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=50 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:18.482046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785f67-aec6-44a9-b44e-9d498fff910d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:18.482728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785f67-aec6-44a9-b44e-9d498fff910d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:18.482728 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785f67-aec6-44a9-b44e-9d498fff910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:18.505024 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0b785f67-aec6-44a9-b44e-9d498fff910d None None] MFA Rules not processed for user `70c70e6c976e47649fc6a279e3eb60d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:18.506962 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0b785f67-aec6-44a9-b44e-9d498fff910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:18.523129 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 631/1259] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:18.924713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443bcc-381e-4450-8942-7b13de9e9a09 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:18.926360 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443bcc-381e-4450-8942-7b13de9e9a09 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:18.926997 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443bcc-381e-4450-8942-7b13de9e9a09 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:18.929103 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 629/1260] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 16 00:57:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:57:18.940710 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c09c-e296-49f5-8efc-04ffadac723c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:18.941315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c09c-e296-49f5-8efc-04ffadac723c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:18.941770 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c09c-e296-49f5-8efc-04ffadac723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:18.995655 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ded9c09c-e296-49f5-8efc-04ffadac723c None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:18.996935 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ded9c09c-e296-49f5-8efc-04ffadac723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.106776 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 632/1261] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 16 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:19.114991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44700ec-e8bf-4ff5-99d1-072e3146dcec None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.115441 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44700ec-e8bf-4ff5-99d1-072e3146dcec None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.116305 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44700ec-e8bf-4ff5-99d1-072e3146dcec None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.118415 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 630/1262] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 16 00:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:57:19.126526 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede307cb-026f-4497-ad80-d2c216a6cd98 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.126983 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede307cb-026f-4497-ad80-d2c216a6cd98 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.127409 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede307cb-026f-4497-ad80-d2c216a6cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.160922 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ede307cb-026f-4497-ad80-d2c216a6cd98 None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:19.162917 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ede307cb-026f-4497-ad80-d2c216a6cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.185102 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 633/1263] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:19.204252 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44700ec-e8bf-4ff5-99d1-072e3146dcec None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:19.207567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-f44700ec-e8bf-4ff5-99d1-072e3146dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.232469 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44700ec-e8bf-4ff5-99d1-072e3146dcec None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:19.249480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6edd-5d4f-4701-98fd-e7441efbcca6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18da5473168d4998bb38de305174819c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:19.251178 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6edd-5d4f-4701-98fd-e7441efbcca6 service glance] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.251829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6edd-5d4f-4701-98fd-e7441efbcca6 service glance] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.252714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6edd-5d4f-4701-98fd-e7441efbcca6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.276571 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6edd-5d4f-4701-98fd-e7441efbcca6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:19.279018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6edd-5d4f-4701-98fd-e7441efbcca6 service glance] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:19.302406 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 631/1264] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:19.958197 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab234-b2e8-4adc-82d7-82c3472ea0a7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.960053 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab234-b2e8-4adc-82d7-82c3472ea0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.960618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab234-b2e8-4adc-82d7-82c3472ea0a7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.963288 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 634/1265] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 16 00:57:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:57:19.977833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589df80-451f-44fe-8149-b4f159b1b813 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.979776 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589df80-451f-44fe-8149-b4f159b1b813 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.980299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589df80-451f-44fe-8149-b4f159b1b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.063541 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-d589df80-451f-44fe-8149-b4f159b1b813 None None] MFA Rules not processed for user `aaaeca0952f04f229b9d53ce1625a1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:20.065207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-d589df80-451f-44fe-8149-b4f159b1b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:20.189943 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 632/1266] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:20.205422 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab234-b2e8-4adc-82d7-82c3472ea0a7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:20.219286 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab234-b2e8-4adc-82d7-82c3472ea0a7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:20.223992 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957476ec-c222-4d06-a5fd-1dbbe81b0491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:20.225423 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957476ec-c222-4d06-a5fd-1dbbe81b0491 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.225726 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957476ec-c222-4d06-a5fd-1dbbe81b0491 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.226233 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957476ec-c222-4d06-a5fd-1dbbe81b0491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.235460 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957476ec-c222-4d06-a5fd-1dbbe81b0491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:20.237035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957476ec-c222-4d06-a5fd-1dbbe81b0491 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:20.246245 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 635/1267] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:20.884761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad079dc-8506-4556-bc29-c3d1a87e2b9b None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.885103 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad079dc-8506-4556-bc29-c3d1a87e2b9b None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.885275 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad079dc-8506-4556-bc29-c3d1a87e2b9b None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.886707 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 633/1268] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 16 00:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:57:20.893603 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb961-973c-412e-abaf-301f48597a5f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.893899 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb961-973c-412e-abaf-301f48597a5f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.894160 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb961-973c-412e-abaf-301f48597a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.928429 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0d4bb961-973c-412e-abaf-301f48597a5f None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:20.930855 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0d4bb961-973c-412e-abaf-301f48597a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:20.950995 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 636/1269] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 16 00:57:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:20.954376 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad079dc-8506-4556-bc29-c3d1a87e2b9b None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:20.957685 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eff6a-47b8-48c9-bbf1-c1e7e6b67f4d None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.958369 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eff6a-47b8-48c9-bbf1-c1e7e6b67f4d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.960365 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eff6a-47b8-48c9-bbf1-c1e7e6b67f4d None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.962563 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 637/1270] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 16 00:57:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:57:20.968622 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dbdd-80ec-4ea1-bfdd-71e71c8072b4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.969035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dbdd-80ec-4ea1-bfdd-71e71c8072b4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.969637 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dbdd-80ec-4ea1-bfdd-71e71c8072b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.992734 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-76d3dbdd-80ec-4ea1-bfdd-71e71c8072b4 None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:20.994475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-76d3dbdd-80ec-4ea1-bfdd-71e71c8072b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:21.005357 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 638/1271] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:57:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:21.022075 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3dbdd-80ec-4ea1-bfdd-71e71c8072b4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:21.039121 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3dbdd-80ec-4ea1-bfdd-71e71c8072b4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:21.046164 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26b02d-8103-4e6f-8677-fcb347a27dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:21.047431 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b02d-8103-4e6f-8677-fcb347a27dee service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.047918 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b02d-8103-4e6f-8677-fcb347a27dee service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.048460 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b02d-8103-4e6f-8677-fcb347a27dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.060201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad079dc-8506-4556-bc29-c3d1a87e2b9b None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:21.067280 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26b02d-8103-4e6f-8677-fcb347a27dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:21.068088 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:21.069245 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.069803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.070186 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.070361 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26b02d-8103-4e6f-8677-fcb347a27dee service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:21.072487 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:21.087295 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:21.088972 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:21.092809 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 639/1272] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:21.106947 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 634/1273] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:23.473470 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47f2c-c43b-457f-8dbd-ace2231720f5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.474054 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47f2c-c43b-457f-8dbd-ace2231720f5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.474210 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47f2c-c43b-457f-8dbd-ace2231720f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.495217 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d7b47f2c-c43b-457f-8dbd-ace2231720f5 None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:23.496982 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d7b47f2c-c43b-457f-8dbd-ace2231720f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:23.506283 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 640/1274] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:23.538193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:23.557939 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c2cc-04a1-40e2-bf15-71d9728c60b9 service placement] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:23.563480 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:23.564112 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.564440 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.564896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.575244 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:23.576951 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:23.587658 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 635/1275] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 00:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:57:24.987620 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e210e-233a-499b-87da-3ef59870dac6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.989380 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e210e-233a-499b-87da-3ef59870dac6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.990148 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e210e-233a-499b-87da-3ef59870dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.066973 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5b7e210e-233a-499b-87da-3ef59870dac6 None None] MFA Rules not processed for user `aaaeca0952f04f229b9d53ce1625a1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:25.070720 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5b7e210e-233a-499b-87da-3ef59870dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.085265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 641/1276] 10.222.0.26 () {58 vars in 1015 bytes} [Sun Oct 16 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:25.241743 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.244175 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.259758 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5cac7-580d-47fe-9537-bf8d5d224b36 service swift] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.264472 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f944f8-69e6-4758-a9f5-7ab4a575b580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.288578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f944f8-69e6-4758-a9f5-7ab4a575b580 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.290115 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f944f8-69e6-4758-a9f5-7ab4a575b580 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.290692 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f944f8-69e6-4758-a9f5-7ab4a575b580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.311421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f944f8-69e6-4758-a9f5-7ab4a575b580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.315092 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f944f8-69e6-4758-a9f5-7ab4a575b580 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.338354 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 636/1277] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:27.037849 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c9936-7517-40f6-a170-4c2421d5ba7c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:27.038911 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c9936-7517-40f6-a170-4c2421d5ba7c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:27.039351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c9936-7517-40f6-a170-4c2421d5ba7c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:27.041201 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 642/1278] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 00:57:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:57:27.127836 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30460e-b0f3-43e6-9aa7-770d27aa8d8a None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:27.129236 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30460e-b0f3-43e6-9aa7-770d27aa8d8a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:27.130013 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30460e-b0f3-43e6-9aa7-770d27aa8d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:27.169111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-5a30460e-b0f3-43e6-9aa7-770d27aa8d8a None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:27.171787 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-5a30460e-b0f3-43e6-9aa7-770d27aa8d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:27.190639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 637/1279] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:27.206044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c9936-7517-40f6-a170-4c2421d5ba7c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:27.225214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c9936-7517-40f6-a170-4c2421d5ba7c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:27.243501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c12c62-0d4d-4454-a4d3-1f9061a15335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:27.244632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c12c62-0d4d-4454-a4d3-1f9061a15335 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:27.245333 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c12c62-0d4d-4454-a4d3-1f9061a15335 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:27.246028 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c12c62-0d4d-4454-a4d3-1f9061a15335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:27.266335 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c12c62-0d4d-4454-a4d3-1f9061a15335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:27.270124 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c12c62-0d4d-4454-a4d3-1f9061a15335 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:27.293491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 643/1280] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:37.159919 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=82 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:37.285214 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=73 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:48.738699 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b887e-d763-43e4-a0e3-3e126db1b803 None None] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.739604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b887e-d763-43e4-a0e3-3e126db1b803 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.739604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b887e-d763-43e4-a0e3-3e126db1b803 None None] PATH_INFO: `/` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.741962 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 638/1281] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 00:57:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:57:48.777715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7b07-d98a-41ac-8912-ed829cbf8238 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.777715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7b07-d98a-41ac-8912-ed829cbf8238 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.777715 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7b07-d98a-41ac-8912-ed829cbf8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.799358 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ba9f7b07-d98a-41ac-8912-ed829cbf8238 None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:48.801642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ba9f7b07-d98a-41ac-8912-ed829cbf8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:48.818402 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 644/1282] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:48.845911 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b887e-d763-43e4-a0e3-3e126db1b803 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.867860 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b887e-d763-43e4-a0e3-3e126db1b803 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.877575 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfba40-1cd6-41f0-91c1-e4649fcf320e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.878626 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfba40-1cd6-41f0-91c1-e4649fcf320e service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.879111 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfba40-1cd6-41f0-91c1-e4649fcf320e service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.879604 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfba40-1cd6-41f0-91c1-e4649fcf320e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.891782 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfba40-1cd6-41f0-91c1-e4649fcf320e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.893639 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfba40-1cd6-41f0-91c1-e4649fcf320e service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.906269 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 639/1283] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:58.791353 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:58.901605 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=6 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:04.150852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8091-96ec-46e5-84e5-3e61387c09a6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:04.151396 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8091-96ec-46e5-84e5-3e61387c09a6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:04.151832 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8091-96ec-46e5-84e5-3e61387c09a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:04.184781 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-de9f8091-96ec-46e5-84e5-3e61387c09a6 None None] MFA Rules not processed for user `e2ee042400a344abbcb0e8bd6f4303f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:04.186950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-de9f8091-96ec-46e5-84e5-3e61387c09a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:04.202195 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 645/1284] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:04.671010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39602-88d9-496c-be55-6bc13d112a62 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:04.671625 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39602-88d9-496c-be55-6bc13d112a62 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:04.671625 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39602-88d9-496c-be55-6bc13d112a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:04.697241 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-54a39602-88d9-496c-be55-6bc13d112a62 None None] MFA Rules not processed for user `aaaeca0952f04f229b9d53ce1625a1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:04.699081 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-54a39602-88d9-496c-be55-6bc13d112a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:04.709687 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 640/1285] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:04.723977 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8091-96ec-46e5-84e5-3e61387c09a6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:04.742036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8091-96ec-46e5-84e5-3e61387c09a6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:04.748350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517dd1-ae76-4f1b-bedf-8f83a22580a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:04.749397 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517dd1-ae76-4f1b-bedf-8f83a22580a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:04.749925 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517dd1-ae76-4f1b-bedf-8f83a22580a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:04.750427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517dd1-ae76-4f1b-bedf-8f83a22580a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:04.765040 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71517dd1-ae76-4f1b-bedf-8f83a22580a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:04.768615 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71517dd1-ae76-4f1b-bedf-8f83a22580a0 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:04.786267 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 646/1286] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:11.682898 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a39602-88d9-496c-be55-6bc13d112a62 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:11.694828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a39602-88d9-496c-be55-6bc13d112a62 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:11.700157 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b5674-87d2-4b56-9400-cb4b20b29fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:11.700956 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5674-87d2-4b56-9400-cb4b20b29fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:11.701128 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5674-87d2-4b56-9400-cb4b20b29fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:11.701437 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5674-87d2-4b56-9400-cb4b20b29fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:11.720460 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b5674-87d2-4b56-9400-cb4b20b29fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:11.722218 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b5674-87d2-4b56-9400-cb4b20b29fe9 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:11.740568 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 641/1287] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:14.778196 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=9 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:18.301860 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659aa67-6c89-40d7-9e1a-3b3709f975e3 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:18.303038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659aa67-6c89-40d7-9e1a-3b3709f975e3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:18.303038 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659aa67-6c89-40d7-9e1a-3b3709f975e3 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:18.304189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 647/1288] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 00:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:58:18.362517 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7fc5-7b3a-4175-aff6-2d1e9146d4a6 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:18.364187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7fc5-7b3a-4175-aff6-2d1e9146d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:18.364187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7fc5-7b3a-4175-aff6-2d1e9146d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:18.406492 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-7fda7fc5-7b3a-4175-aff6-2d1e9146d4a6 None None] MFA Rules not processed for user `94c3191543bd4843be4f6db40a98122b`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:18.410090 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-7fda7fc5-7b3a-4175-aff6-2d1e9146d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:18.430425 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 642/1289] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:18.464908 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659aa67-6c89-40d7-9e1a-3b3709f975e3 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:18.492154 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659aa67-6c89-40d7-9e1a-3b3709f975e3 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:18.502789 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd090b-10f4-4f9f-be67-2a744f0c6acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:18.504265 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd090b-10f4-4f9f-be67-2a744f0c6acb service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:18.505040 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd090b-10f4-4f9f-be67-2a744f0c6acb service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:18.505826 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd090b-10f4-4f9f-be67-2a744f0c6acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:18.527023 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd090b-10f4-4f9f-be67-2a744f0c6acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:18.530427 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd090b-10f4-4f9f-be67-2a744f0c6acb service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:18.551522 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 648/1290] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:58:28.396276 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=12 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:28.542269 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:05.239427 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04674d71-238d-40c0-802a-d610bd7613be None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:05.240168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04674d71-238d-40c0-802a-d610bd7613be None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:05.240168 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04674d71-238d-40c0-802a-d610bd7613be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:05.260444 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-04674d71-238d-40c0-802a-d610bd7613be None None] MFA Rules not processed for user `e2ee042400a344abbcb0e8bd6f4303f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:05.261678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-04674d71-238d-40c0-802a-d610bd7613be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:05.269668 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 643/1291] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:59:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:15.255317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:18.960458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c354-ef05-4b8e-95ad-4e99ad4da7c3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:18.960969 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c354-ef05-4b8e-95ad-4e99ad4da7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:18.961060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c354-ef05-4b8e-95ad-4e99ad4da7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:18.981707 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6cc4c354-ef05-4b8e-95ad-4e99ad4da7c3 None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:18.982942 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6cc4c354-ef05-4b8e-95ad-4e99ad4da7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:18.990371 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 649/1292] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 00:59:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:19.031854 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04674d71-238d-40c0-802a-d610bd7613be None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:19.044997 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04674d71-238d-40c0-802a-d610bd7613be None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:19.050118 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560b551-63b1-423f-b183-65dda7789149 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:19.050747 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560b551-63b1-423f-b183-65dda7789149 service swift] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:19.051024 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560b551-63b1-423f-b183-65dda7789149 service swift] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:19.051314 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560b551-63b1-423f-b183-65dda7789149 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:19.059351 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560b551-63b1-423f-b183-65dda7789149 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:19.060969 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560b551-63b1-423f-b183-65dda7789149 service swift] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:19.069332 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 644/1293] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 00:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:59:24.454571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bf89-9f01-416f-8c4f-99b00eb4a2d9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:24.455073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bf89-9f01-416f-8c4f-99b00eb4a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:24.455158 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bf89-9f01-416f-8c4f-99b00eb4a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:24.476044 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2c12bf89-9f01-416f-8c4f-99b00eb4a2d9 None None] MFA Rules not processed for user `e2ee042400a344abbcb0e8bd6f4303f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:24.477351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2c12bf89-9f01-416f-8c4f-99b00eb4a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:24.484241 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 650/1294] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:29.065829 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=6 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:34.470199 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:57.305019 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe01b1-c2aa-4e6a-9f2c-67a2c5f6747a None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:57.305714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe01b1-c2aa-4e6a-9f2c-67a2c5f6747a None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:57.305996 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe01b1-c2aa-4e6a-9f2c-67a2c5f6747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:57.341382 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-b5fe01b1-c2aa-4e6a-9f2c-67a2c5f6747a None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:57.343422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b5fe01b1-c2aa-4e6a-9f2c-67a2c5f6747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:57.357220 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 645/1295] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 16 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:57.375131 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bf89-9f01-416f-8c4f-99b00eb4a2d9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:57.389159 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bf89-9f01-416f-8c4f-99b00eb4a2d9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:57.395391 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc097df8-e234-451e-98fe-6349ac1a33b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:57.396117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc097df8-e234-451e-98fe-6349ac1a33b1 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:57.396690 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc097df8-e234-451e-98fe-6349ac1a33b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:57.397011 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc097df8-e234-451e-98fe-6349ac1a33b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:57.413501 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc097df8-e234-451e-98fe-6349ac1a33b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:57.416836 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc097df8-e234-451e-98fe-6349ac1a33b1 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:57.433953 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 651/1296] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 00:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:00:07.332798 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=3 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:07.426883 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:25.500362 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f746-d4b0-4d97-97df-b7207c7d7f31 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.501010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f746-d4b0-4d97-97df-b7207c7d7f31 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.501010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f746-d4b0-4d97-97df-b7207c7d7f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.524611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-be10f746-d4b0-4d97-97df-b7207c7d7f31 None None] MFA Rules not processed for user `e2ee042400a344abbcb0e8bd6f4303f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:25.526855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-be10f746-d4b0-4d97-97df-b7207c7d7f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:25.536335 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 646/1297] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:28.136669 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3728-4359-427b-9512-044dbea47036 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:28.137498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3728-4359-427b-9512-044dbea47036 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:28.137498 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3728-4359-427b-9512-044dbea47036 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:28.138697 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 652/1298] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 16 01:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:00:28.145773 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fced3c-1d02-4df1-9081-360a5ef4e560 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:28.146634 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fced3c-1d02-4df1-9081-360a5ef4e560 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:28.146846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fced3c-1d02-4df1-9081-360a5ef4e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:28.168904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-a3fced3c-1d02-4df1-9081-360a5ef4e560 None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:28.170152 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a3fced3c-1d02-4df1-9081-360a5ef4e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:28.179927 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 647/1299] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 16 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:28.188208 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf3728-4359-427b-9512-044dbea47036 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:28.204143 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf3728-4359-427b-9512-044dbea47036 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:28.211018 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:28.211667 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:28.211950 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:28.212231 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:28.223487 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:28.225337 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:28.238041 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 653/1300] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:38.163046 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=6 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:38.232144 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:44.781217 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fced3c-1d02-4df1-9081-360a5ef4e560 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:44.792463 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fced3c-1d02-4df1-9081-360a5ef4e560 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:44.796081 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:44.796739 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.797020 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.797299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.809033 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:44.811000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:44.822905 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 648/1301] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:54.818000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=6 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:31.788119 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:31.801596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951ae7-ae5c-4547-8394-a00e3b18866f service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:31.806963 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:31.807563 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:31.807852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:31.808128 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:31.815843 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:31.817674 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:31.826536 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 654/1302] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:31.875804 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:31.884224 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f2e2-c598-4756-8b53-c64fc2772b6f service neutron] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:31.887859 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:31.888486 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:31.888765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:31.889039 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:31.901071 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:31.902642 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:31.914980 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 649/1303] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:32.486014 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:32.498319 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f669c-c2f3-47a3-8d5d-e18b13225bab service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:32.504172 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:32.505509 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:32.505509 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:32.505509 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:32.520960 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:32.522544 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:32.539577 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 655/1304] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:37.819699 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:37.828683 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecd46e-fc2e-4214-9e91-4f4c1b019fcf service neutron] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:37.832837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a686d-e0aa-4ec4-a027-9d821f9ddb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:37.833458 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a686d-e0aa-4ec4-a027-9d821f9ddb70 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:37.833991 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a686d-e0aa-4ec4-a027-9d821f9ddb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:37.834264 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a686d-e0aa-4ec4-a027-9d821f9ddb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:37.845224 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a686d-e0aa-4ec4-a027-9d821f9ddb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:37.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a686d-e0aa-4ec4-a027-9d821f9ddb70 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:37.857861 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 650/1305] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:39.220223 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:39.241404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ccf56-c0ff-4cba-a7ef-a78cf6dff661 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:39.248987 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:39.249906 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:39.250186 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:39.250456 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:39.261968 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:39.263569 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:39.275526 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 656/1306] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:02:40.322828 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871718ec-d77f-432a-ac21-1737f403a1ca None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:40.323341 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871718ec-d77f-432a-ac21-1737f403a1ca None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:40.324023 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871718ec-d77f-432a-ac21-1737f403a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:40.355348 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-871718ec-d77f-432a-ac21-1737f403a1ca None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:40.357610 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-871718ec-d77f-432a-ac21-1737f403a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:40.369091 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 651/1307] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 16 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:40.425351 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:40.440166 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583a0f-b06f-4180-86e7-4d2b9ab11d85 service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:40.447588 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:40.448595 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:40.449081 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:40.449571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:40.460985 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:40.462578 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:40.471142 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 657/1308] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 01:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:41.062193 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40441fd-003c-42a4-80b4-d18ad838a635 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.062486 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40441fd-003c-42a4-80b4-d18ad838a635 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.062765 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40441fd-003c-42a4-80b4-d18ad838a635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.084477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-e40441fd-003c-42a4-80b4-d18ad838a635 None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:41.085693 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e40441fd-003c-42a4-80b4-d18ad838a635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.093162 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 652/1309] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:41.106144 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:41.117572 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730dea4-f104-48d3-b25a-38e50c551e8f service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:41.122792 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:41.123496 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.123774 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.124052 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.133679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:41.135315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:41.144229 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 658/1310] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 01:02:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:49.821180 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3178361-2c49-4999-8169-d306d2ff3faf None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.821699 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3178361-2c49-4999-8169-d306d2ff3faf None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.821699 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3178361-2c49-4999-8169-d306d2ff3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.842010 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-a3178361-2c49-4999-8169-d306d2ff3faf None None] MFA Rules not processed for user `70c70e6c976e47649fc6a279e3eb60d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:49.843221 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-a3178361-2c49-4999-8169-d306d2ff3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:49.850142 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 653/1311] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:50.447935 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:50.459697 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bad38-87fa-4c32-a44a-1aa6cac7c6a3 service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:50.465344 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:50.466071 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.466416 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.466783 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.476743 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:50.478415 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:50.489967 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 659/1312] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:51.951477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661ae88-78b2-4741-85de-2b503c77645d None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.951993 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661ae88-78b2-4741-85de-2b503c77645d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.952191 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661ae88-78b2-4741-85de-2b503c77645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.974563 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-2661ae88-78b2-4741-85de-2b503c77645d None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:51.975769 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-2661ae88-78b2-4741-85de-2b503c77645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:51.982965 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 654/1313] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 16 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:51.997073 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.018242 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908488b-bcd2-4b7c-9c07-9e1da8737698 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.028189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4dacb-446b-4203-8396-66b73ec092a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.029274 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4dacb-446b-4203-8396-66b73ec092a0 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.029785 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4dacb-446b-4203-8396-66b73ec092a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.030290 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4dacb-446b-4203-8396-66b73ec092a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.042534 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4dacb-446b-4203-8396-66b73ec092a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.044036 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4dacb-446b-4203-8396-66b73ec092a0 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.053654 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 660/1314] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 01:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:00.826784 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661ae88-78b2-4741-85de-2b503c77645d None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.834409 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=25 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:00.841374 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661ae88-78b2-4741-85de-2b503c77645d None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.846903 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.848015 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.848298 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.848607 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.857187 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.858779 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.869511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 655/1315] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:02.049315 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=42 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:08.559324 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8caf71-ac2b-49cc-b6dc-f1c24b8874cb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.560573 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8caf71-ac2b-49cc-b6dc-f1c24b8874cb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.560573 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8caf71-ac2b-49cc-b6dc-f1c24b8874cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.584076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ca8caf71-ac2b-49cc-b6dc-f1c24b8874cb None None] MFA Rules not processed for user `e2ee042400a344abbcb0e8bd6f4303f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:08.585452 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ca8caf71-ac2b-49cc-b6dc-f1c24b8874cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:08.593126 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 661/1316] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:09.098045 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:09.113938 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ee3d4-2ca9-4ab0-8e14-89bed57961d1 service nova] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:09.120102 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:09.121181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:09.121714 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:09.122179 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:09.135734 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:09.138280 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:09.154132 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 656/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:10.762294 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8caf71-ac2b-49cc-b6dc-f1c24b8874cb None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:10.781368 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8caf71-ac2b-49cc-b6dc-f1c24b8874cb None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:10.788881 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:10.789571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:10.789852 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:10.790128 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:10.800462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:10.816866 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:10.852400 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 662/1318] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:19.147222 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=11 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:20.827372 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=9 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:24.890593 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:24.900343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0437e-5a1a-49af-8c06-0087715487ab service neutron] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:24.914297 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d199d6-c474-4a63-aaf6-6c4ff166b574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:24.915317 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d199d6-c474-4a63-aaf6-6c4ff166b574 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:24.916746 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d199d6-c474-4a63-aaf6-6c4ff166b574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:24.917061 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d199d6-c474-4a63-aaf6-6c4ff166b574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:24.932285 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d199d6-c474-4a63-aaf6-6c4ff166b574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:24.934910 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d199d6-c474-4a63-aaf6-6c4ff166b574 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:24.952043 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 657/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:27.059432 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:27.073286 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58436b38-bc64-4729-b0ae-1e8e1ec9b10a service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:27.079646 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:27.080627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:27.081437 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:27.081873 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:27.094244 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:27.096941 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:27.125605 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 663/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:34.945165 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=6 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:37.105987 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:29.991903 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:29.992539 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:29.992539 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:30.022218 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] MFA Rules not processed for user `e2ee042400a344abbcb0e8bd6f4303f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:30.023435 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:30.048674 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 658/1321] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 16 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:30.388627 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:30.390298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:30.445871 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ac23f-0870-4585-9839-e03fc168e5bf service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:30.449642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:30.450256 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:30.450541 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:30.450818 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:30.459275 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:30.460764 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:30.469153 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 664/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:32.482855 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:32.484299 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:32.529758 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3fb2-0ca8-4c60-9b8d-34acf2d2c612 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:32.535600 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cf97f-fd8e-4863-acb8-2b0fdbc98728 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:32.536304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cf97f-fd8e-4863-acb8-2b0fdbc98728 service placement] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:32.536610 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cf97f-fd8e-4863-acb8-2b0fdbc98728 service placement] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:32.536875 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cf97f-fd8e-4863-acb8-2b0fdbc98728 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:32.538760 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-527cf97f-fd8e-4863-acb8-2b0fdbc98728 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:32.551540 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cf97f-fd8e-4863-acb8-2b0fdbc98728 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:32.553194 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cf97f-fd8e-4863-acb8-2b0fdbc98728 service placement] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:32.563664 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 659/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:40.465566 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=24 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:42.559300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=33 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:48.662880 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:48.673046 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd360-fbfd-4a15-99f1-a9ca9a081012 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:48.678932 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:48.680060 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:48.680364 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:48.680788 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:48.692980 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:48.694453 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:48.705433 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 665/1324] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:05:56.121650 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eed40-d6e1-4d27-a281-9f0c382a9e2d None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:56.122361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eed40-d6e1-4d27-a281-9f0c382a9e2d None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:56.122361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eed40-d6e1-4d27-a281-9f0c382a9e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:56.153578 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-ab5eed40-d6e1-4d27-a281-9f0c382a9e2d None None] MFA Rules not processed for user `bd96097b685d4e329ec46d0cfa19bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:56.154819 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-ab5eed40-d6e1-4d27-a281-9f0c382a9e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:56.173055 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 660/1325] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 16 01:05:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:56.219929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:56.233237 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4c92f-be00-4758-a452-41b6fc11df06 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:56.238482 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9c879-934a-4869-b514-916f105cac23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad81ce2fa0644dae929e51279b7f9b76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:56.239112 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9c879-934a-4869-b514-916f105cac23 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:56.239395 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9c879-934a-4869-b514-916f105cac23 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:56.239672 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9c879-934a-4869-b514-916f105cac23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:56.248550 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9c879-934a-4869-b514-916f105cac23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:56.250182 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9c879-934a-4869-b514-916f105cac23 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:56.259884 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 666/1326] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:56.665092 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eed40-d6e1-4d27-a281-9f0c382a9e2d None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:56.675896 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eed40-d6e1-4d27-a281-9f0c382a9e2d None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:56.679894 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2115c-99e3-4dd6-8950-6fb3be6272ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:56.680548 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2115c-99e3-4dd6-8950-6fb3be6272ee service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:56.680833 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2115c-99e3-4dd6-8950-6fb3be6272ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:56.681109 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2115c-99e3-4dd6-8950-6fb3be6272ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:56.763661 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2115c-99e3-4dd6-8950-6fb3be6272ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:56.765430 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2115c-99e3-4dd6-8950-6fb3be6272ee service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:56.786998 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 661/1327] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:00.434949 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d38f7d-4c0b-4779-a7e4-e7551a5e2554 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.435480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d38f7d-4c0b-4779-a7e4-e7551a5e2554 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.435566 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d38f7d-4c0b-4779-a7e4-e7551a5e2554 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.436989 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 667/1328] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 01:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:06:00.450424 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3e9a7-5419-4cbe-94d0-a432e703d0ed None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.450995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3e9a7-5419-4cbe-94d0-a432e703d0ed None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.450995 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3e9a7-5419-4cbe-94d0-a432e703d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.513234 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-7bd3e9a7-5419-4cbe-94d0-a432e703d0ed None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:00.514473 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-7bd3e9a7-5419-4cbe-94d0-a432e703d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:00.529511 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 662/1329] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:00.542573 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d38f7d-4c0b-4779-a7e4-e7551a5e2554 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.557799 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d38f7d-4c0b-4779-a7e4-e7551a5e2554 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.563401 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.564127 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.564444 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.564717 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.576437 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.578168 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.593475 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 668/1330] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:04.034968 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3e9a7-5419-4cbe-94d0-a432e703d0ed None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:04.048018 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3e9a7-5419-4cbe-94d0-a432e703d0ed None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:04.055941 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:04.056642 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:04.056929 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:04.057207 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] PATH_INFO: `/v3/users/70c70e6c976e47649fc6a279e3eb60d7` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:04.058421 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c70e6c976e47649fc6a279e3eb60d7)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:04.060737 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:04.118928 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c70e6c976e47649fc6a279e3eb60d7'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.127126 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c70e6c976e47649fc6a279e3eb60d7'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.128209 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c70e6c976e47649fc6a279e3eb60d7'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.135879 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c70e6c976e47649fc6a279e3eb60d7'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.136621 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c70e6c976e47649fc6a279e3eb60d7'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.150474 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:04.156530 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 663/1331] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:04 2022] DELETE /identity/v3/users/70c70e6c976e47649fc6a279e3eb60d7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:04.381502 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:04.392596 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f335-9772-43a8-8f30-43eb8a022aa8 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:04.469461 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:04.470111 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:04.470393 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:04.470662 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] PATH_INFO: `/v3/projects/8e2ea3f2089d47fe921d37f90a266b52` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:04.472360 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2ea3f2089d47fe921d37f90a266b52)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:04.474308 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:04.530820 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2ea3f2089d47fe921d37f90a266b52', 'request_id': 'req-2a0511ed-8f59-4269-b125-c98418827573'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.540868 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2ea3f2089d47fe921d37f90a266b52', 'request_id': 'req-2a0511ed-8f59-4269-b125-c98418827573'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.547679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2ea3f2089d47fe921d37f90a266b52', 'request_id': 'req-2a0511ed-8f59-4269-b125-c98418827573'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.577694 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] The token cache is being invalidate because project 8e2ea3f2089d47fe921d37f90a266b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:04.578008 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.578679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.580203 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 669/1332] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:04 2022] DELETE /identity/v3/projects/8e2ea3f2089d47fe921d37f90a266b52 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:04.584633 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:04.586110 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:04.600067 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2164d5-ba44-4de0-aca9-5b993caf9d35 admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:04.664181 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:04.664880 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:04.665163 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:04.665494 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] PATH_INFO: `/v3/users/4b2b714e88544867af3d4d2b080523dd` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:04.666761 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2b714e88544867af3d4d2b080523dd)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:04.669050 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:04.745825 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2b714e88544867af3d4d2b080523dd'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.757477 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2b714e88544867af3d4d2b080523dd'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.758304 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2b714e88544867af3d4d2b080523dd'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.766422 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2b714e88544867af3d4d2b080523dd'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.767171 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2b714e88544867af3d4d2b080523dd'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:04.787688 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 664/1333] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:04 2022] DELETE /identity/v3/users/4b2b714e88544867af3d4d2b080523dd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:04.989811 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:04.991936 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:05.006248 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0511ed-8f59-4269-b125-c98418827573 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:05.053813 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:05.075929 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:05.076630 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:05.076915 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:05.077189 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] PATH_INFO: `/v3/projects/ac2c743cd8724a44b85eeeac25b59d9e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:05.078442 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2c743cd8724a44b85eeeac25b59d9e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:05.080462 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:05.132679 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2c743cd8724a44b85eeeac25b59d9e', 'request_id': 'req-c3583ef5-fbf9-42be-bdbd-88448c58569d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:05.140085 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2c743cd8724a44b85eeeac25b59d9e', 'request_id': 'req-c3583ef5-fbf9-42be-bdbd-88448c58569d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:05.147632 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2c743cd8724a44b85eeeac25b59d9e', 'request_id': 'req-c3583ef5-fbf9-42be-bdbd-88448c58569d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:05.162573 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] The token cache is being invalidate because project ac2c743cd8724a44b85eeeac25b59d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:05.162897 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:05.163566 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:05.165125 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 670/1334] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:04 2022] DELETE /identity/v3/projects/ac2c743cd8724a44b85eeeac25b59d9e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:14.783647 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:15.159706 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:39.172735 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:39.174525 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:39.255567 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c925c-18c0-471b-aaf4-a69f80a32a6b admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:39.280116 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:39.281526 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:39.322077 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:39.322697 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:39.322977 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:39.323251 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:39.329464 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:39.340433 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:39.342201 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:39.342986 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583ef5-fbf9-42be-bdbd-88448c58569d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:39.346681 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:39.347295 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:39.347571 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:39.347842 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:39.349611 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:39.351957 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 665/1335] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:39.440232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:39.441749 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:39.465742 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 671/1336] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:07:40.657854 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:40.669678 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7b8f-c29e-4fae-a205-07c9d35d65f4 service neutron] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:40.673801 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:40.674442 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:40.674727 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:40.675000 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:40.676784 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:40.691300 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:40.692803 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:40.705036 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 666/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:41.543035 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:41.545491 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:41.572350 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48047-408c-48fc-abfc-3c11488e0b81 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:41.580590 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f12c-9646-4269-83bf-b8a62cd575de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c3191543bd4843be4f6db40a98122b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:41.581414 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f12c-9646-4269-83bf-b8a62cd575de service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:41.581730 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f12c-9646-4269-83bf-b8a62cd575de service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:41.582071 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f12c-9646-4269-83bf-b8a62cd575de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:41.584404 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ef24f12c-9646-4269-83bf-b8a62cd575de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:41.598461 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f12c-9646-4269-83bf-b8a62cd575de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:41.600075 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f12c-9646-4269-83bf-b8a62cd575de service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:41.616232 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 672/1338] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:50.699843 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=52 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:51.607458 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=69 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:52.004448 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:52.013713 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3c4d6-99c2-49dd-8f99-c1cf4f99795d service neutron] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:52.017445 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368025b-6c42-4bc2-975a-93a60d8824d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaaeca0952f04f229b9d53ce1625a1d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:52.018051 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368025b-6c42-4bc2-975a-93a60d8824d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:52.018326 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368025b-6c42-4bc2-975a-93a60d8824d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:52.018597 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368025b-6c42-4bc2-975a-93a60d8824d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:52.020509 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-e368025b-6c42-4bc2-975a-93a60d8824d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:52.092343 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368025b-6c42-4bc2-975a-93a60d8824d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:52.093841 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368025b-6c42-4bc2-975a-93a60d8824d8 service neutron] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:52.104992 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 667/1339] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:55.505521 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760021ba-ce18-43d8-b3e1-2db5ac0c57a7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:55.506250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760021ba-ce18-43d8-b3e1-2db5ac0c57a7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:55.506250 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760021ba-ce18-43d8-b3e1-2db5ac0c57a7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:55.507968 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 673/1340] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 16 01:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:07:55.523277 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] REQUEST_METHOD: `POST` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:55.524361 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:55.524592 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:55.553004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.auth.core [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] MFA Rules not processed for user `b2981a8784a642f2945ed41d32112100`. Rule list: `[]` (Enabled: `True`). {{(pid=81417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:55.554642 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:55.652576 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 668/1341] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 16 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:55.665846 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760021ba-ce18-43d8-b3e1-2db5ac0c57a7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:55.669459 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-760021ba-ce18-43d8-b3e1-2db5ac0c57a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:55.687664 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760021ba-ce18-43d8-b3e1-2db5ac0c57a7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:55.692936 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:55.693580 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:55.693863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:55.694135 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:55.704076 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:55.705816 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:55.717905 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 674/1342] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:58.965985 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:58.967702 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:58.986434 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac858b0-a492-4c47-84b0-c7ae695e89e7 None None] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:58.996306 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:58.997005 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:58.997284 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:58.997557 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] PATH_INFO: `/v3/users/e2ee042400a344abbcb0e8bd6f4303f3` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:59.015785 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ee042400a344abbcb0e8bd6f4303f3)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:59.017813 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:59.069806 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ee042400a344abbcb0e8bd6f4303f3'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.077738 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ee042400a344abbcb0e8bd6f4303f3'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.078539 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ee042400a344abbcb0e8bd6f4303f3'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.091033 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ee042400a344abbcb0e8bd6f4303f3'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.091783 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ee042400a344abbcb0e8bd6f4303f3'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.099904 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:59.112952 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 669/1343] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:58 2022] DELETE /identity/v3/users/e2ee042400a344abbcb0e8bd6f4303f3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:59.305934 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:59.317719 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a617ec-0407-45ef-9b4d-df6cb13174b7 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:59.386657 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:59.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:59.387586 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:59.387863 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] PATH_INFO: `/v3/projects/901562bad87f43dcac6dfb7d16d40e95` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:59.400030 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=901562bad87f43dcac6dfb7d16d40e95)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:59.402213 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:59.456027 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901562bad87f43dcac6dfb7d16d40e95', 'request_id': 'req-dd599adf-fb15-40b9-965e-98ca440df700'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.466344 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901562bad87f43dcac6dfb7d16d40e95', 'request_id': 'req-dd599adf-fb15-40b9-965e-98ca440df700'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.472473 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901562bad87f43dcac6dfb7d16d40e95', 'request_id': 'req-dd599adf-fb15-40b9-965e-98ca440df700'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.490032 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] The token cache is being invalidate because project 901562bad87f43dcac6dfb7d16d40e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:07:59.490318 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.491291 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.493834 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 675/1344] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:59 2022] DELETE /identity/v3/projects/901562bad87f43dcac6dfb7d16d40e95 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:07:59.498796 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:59.501090 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:59.523038 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009f8b-5acb-4c0a-86fc-0876fc37e4eb admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:59.597764 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:59.598327 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:59.598601 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:59.598871 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] PATH_INFO: `/v3/users/4ad9f3e393a2491da671024203c54e43` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:59.616142 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad9f3e393a2491da671024203c54e43)` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:59.618202 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:59.688370 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad9f3e393a2491da671024203c54e43'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.698611 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad9f3e393a2491da671024203c54e43'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.699249 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad9f3e393a2491da671024203c54e43'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.708867 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad9f3e393a2491da671024203c54e43'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.709598 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.notifications [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad9f3e393a2491da671024203c54e43'} {{(pid=81417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.735467 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 670/1345] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:59 2022] DELETE /identity/v3/users/4ad9f3e393a2491da671024203c54e43 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:59.932278 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:59.934122 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:59.949753 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd599adf-fb15-40b9-965e-98ca440df700 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:00.020059 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d9127a36484f1999634ad75717a07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4625f8f78c492a895e7a32f39f3d29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:00.020739 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:00.021117 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:00.021304 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] PATH_INFO: `/v3/projects/a9224baaf1b54b29acd25794117e3a24` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:00.034480 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9224baaf1b54b29acd25794117e3a24)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:00.036563 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:00.038388 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:00.106631 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9224baaf1b54b29acd25794117e3a24', 'request_id': 'req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.115642 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9224baaf1b54b29acd25794117e3a24', 'request_id': 'req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.122641 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9224baaf1b54b29acd25794117e3a24', 'request_id': 'req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.137618 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] The token cache is being invalidate because project a9224baaf1b54b29acd25794117e3a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:08:00.138016 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.138670 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d629ec4b-ff99-4055-a53f-99c71ab2a3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.140298 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 676/1346] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:59 2022] DELETE /identity/v3/projects/a9224baaf1b54b29acd25794117e3a24 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:09.728491 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:10.133454 dv-osbrick-master-4-iscsi devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:18.435569 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Authenticating user token {{(pid=81417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:18.437004 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:18.504863 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200418d-8272-46ad-abbf-7fc2158a17ba admin admin] Validating token access rules against request {{(pid=81417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:18.561846 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276ba81-bcd4-41a9-ab46-f4b007f702ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2981a8784a642f2945ed41d32112100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caa359a8225241c9a4322ed6c105402c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:18.562451 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ba81-bcd4-41a9-ab46-f4b007f702ca service placement] REQUEST_METHOD: `GET` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:18.562731 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ba81-bcd4-41a9-ab46-f4b007f702ca service placement] SCRIPT_NAME: `/identity` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:18.563006 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ba81-bcd4-41a9-ab46-f4b007f702ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:18.564837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.fernet_utils [None req-c276ba81-bcd4-41a9-ab46-f4b007f702ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:18.576238 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ba81-bcd4-41a9-ab46-f4b007f702ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:18.577837 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ba81-bcd4-41a9-ab46-f4b007f702ca service placement] RBAC: Authorization granted {{(pid=81417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:18.588050 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: [pid: 81417|app: 0|req: 671/1347] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:28.583632 dv-osbrick-master-4-iscsi devstack@keystone.service[81417]: DEBUG dbcounter [-] [81417] Writing DB stats keystone:SELECT=58 {{(pid=81417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}